Detecting physical abilities through smartphone sensors: an assistive technology application

Purpose It is important to promote assistive technologies to improve quality of life. The proposed SmartAbility Android Application recommends assistive technologies for people with reduced physical abilities, by focussing on actions that can be performed independently. Materials and methods The SmartAbility Application uses Android built-in sensors, e.g., accelerometer and gyroscope and application programming interfaces (APIs) to detect physical abilities, e.g., head movements and blowing and recommend suitable assistive technologies. This is supported by a MySQL database that stores assistive technologies and mappings between abilities. The underpinning research is the SmartAbility Framework that culminates the knowledge obtained during previously feasibility trials and usability evaluations. Results The Application was evaluated by pupils (n = 18) at special educational needs schools with physical conditions, including cerebral palsy, autism and Noonan syndrome, and assessed through the NASA Task Load Index (TLX) and System Usability Scale (SUS). Analysis using the Adjective Rating Scale highlighted that the Application achieves "Good Usability". Conclusion The SmartAbility Application demonstrates that built-in sensors of Android devices and their APIs, can detect actions that users perform, e.g., head movements and speaking. The Application contains a database where assistive technologies are mapped to physical abilities, in order to provide suitable recommendations. It will be disseminated to assistive technology charities and manufacturers and be used by healthcare professionals as part of the rehabilitation process. Future developments of SmartAbility include the creation of a second Application designed specifically to recommend assistive technologies for the education sector, based on users' physical and cognitive abilities.