“The technology is expected to increase brain connectivity by stimulating the new neural connections needed to repair the losses caused by injury or by the patient’s clinical condition,” Alexandre Brandão, a researcher at the University of Campinas’s Physics Institute (IFGW-UNICAMP), told Agência FAPESP. Brandão is also affiliated with the Brazilian Research Institute for Neuroscience and Neurotechnology (BRAINN), one of the Research, Innovation and Dissemination Centers (RIDCs) supported by FAPESP.
The study described in the paper resulted in the development of a wearable device called Biomechanics Sensor Node (BSN) that captures user data and controls virtual environments, as well as a new software solution integrating the BSN with Unity Editor, one of the most widely used game engines and virtual world-building programs. “Integration of the wearable with the Unity software means patients undergoing motor rehabilitation can interact with VR environments while the therapist views data for the movements performed during the session,” Brandão explained.
The BSN consists of an inertial sensor that is placed on the user’s ankle, detects motion relative to stationary gait, and tracks the body in the three planes of movement. The signals generated are processed and transmitted to a smartphone, which is used to control an avatar that interacts with the virtual environment. “The patient’s actual movements may be very limited or small, but in the virtual context the captured and processed data generates complete movements by the avatar,” Brandão said. “The visual information gives patients the impression they’re able to perform these complete movements, and this can potentially activate more neural networks than conventional mechanical therapy.”
Functional magnetic resonance imaging (fMRI) scans show that the procedure activates specific brain regions associated with these fictitious movements. A next step entails performing clinical tests to measure the functional gains in the patient’s motor recovery. Another expected development will be to have the avatar engage in everyday activities, practice sports, or interact with other people in a multi-user virtual environment.