Mixed Reality and IoT for Physical Rehabilitation

This article describes a solution for physical rehabilitation of upper members using hot technologies such as mixed reality (MR) and Internet of Things (IoT). Serious games were developed in Unity for MR scenario using Meta Quest 2 as MX interface, and smart sensors inserted onto a pair of gloves that are used to perform real-time measurements. The smart sensors based on Arduino Nano boards that receive the data from measurement channels that include finger force and finger flexion sensors. The smart sensors are connected through Bluetooth with the MR headset. The obtained data is sent to a cloud data-base created in Amazon RDS. The communications with the database are done using .php scripts allocated on a virtual machine created by Amazon EC2. The obtained data is then observable on a cross-platform application for smartphones where the user can visualize the exercise data and create new users. Experimental results and discussions are included in the paper as part of system validation.