Assistive technologies that combine smart glasses, smart gadgets and magnetic...
Assistive technologies that combine smart glasses, smart gadgets and magnetic skins with a smart wheelchair are allowing wheelchair users with limited mobility to move more freely.
Source: 2021 KAUST; Anastasia Serin

Smart tech broads horizons for people with quadriplegia

A system that uses flexible, breathable magnetic skin allows people with severe quadriplegia to move around and choose their surroundings. Developed by KAUST researchers, the high-tech system relies on the user's facial expressions to accomplish a wide variety of tasks, from moving down the street to using an elevator.

There are a wide variety of assistive technologies for people with quadriplegia, but most systems are not suitable for patients with severe quadriplegia as they often rely on head or neck movements to work. For these patients, the options are limited to camera, tongue control, voice-assistant and neural detector systems. But these either offer a limited range of gestures or are not compatible with outdoor applications. Some also require invasive attachments or continuous attention while using the system.

"Most existing technologies don't give people a lot of freedom," says Abdullah Almansouri, a Ph.D. student in KAUST. "We wanted to develop a solution that works inside the house as well as outdoors, allowing them to move around independently."

The new integrated system includes magnetic skins, smart glasses, a smart wheelchair and smart gadgets that rely on wireless Bluetooth and infrared communication.

The three magnetic skins are placed between the eyebrows and on each side of the nose to track facial movements, such as moving the eyebrows up and down and the nose left and right. These movements are detected by magnetic field sensors in the smart glasses and are converted into electrical signals that are transmitted to the head unit of the wheelchair.

Sensors in the smart glasses detect facial movements through the flexible and...
Sensors in the smart glasses detect facial movements through the flexible and breathable magnetic skin, which are converted to electrical signals that are transmitted to the wheelchair.
Source: 2021 KAUST; Anastasia Serin

This unit processes these signals into wheelchair or smart gadget commands, such as turning the lights on or clicking the mouse on a computer. The system currently supports 13 distinct facial gestures.

"We were aiming for something easy and accessible but also that couldn't be easily triggered by accident," says Almansouri. "The system itself handles the complexity, so the user is only wearing the glasses and magnetic skin to control their surroundings."

With his team, Almansouri tested the system on three able-bodied users with a high success rate. The participants took less than 15 minutes to learn how to use the system without assistance, with a worst-case success rate of 93 percent.

"The synergetic combination of advanced sensor technology and machine learning will definitely improve quality of life," says Khaled Salama, professor of electrical and computer engineering at KAUST's Advanced Membranes and Porous Materials Center. "This combination has the potential to be a game-changer in so many applications."

Subscribe to our newsletter

Related articles

Humanising wearable health technologies

Humanising wearable health technologies

Designer Leah Heiss considers her work as creating “emotional technologies”, i.e. wearable devices based on human-centred design principles. For her, empathy is everything!

Smart ring detects COVID-19 early

Smart ring detects COVID-19 early

According to new research, the Oura smart ring is indeed suitable for detecting COVID-19 infection up to three days before symptoms appear.

Verifying and validating the clinical usefulness of wearables

Verifying and validating the clinical usefulness of wearables

Researchers have developed a framework that will help data scientists and other researchers use better digital health tools for clinical purposes.

Can ‘smart toilets’ be the next

Can ‘smart toilets’ be the next

Wearables are transforming the ability to monitor and improve health, but a decidedly low-tech commodity—the humble toilet—may have potential to outperform them all.

Smart insole monitors foot health for diabetic patients

Smart insole monitors foot health for diabetic patients

The smart insole can be inserted into a sneaker or dress shoe to passively monitor the foot health of a person living with diabetes.

EYEMATE sensor is a sentinel to watch over ocular pressure

EYEMATE sensor is a sentinel to watch over ocular pressure

The sensor system implant provides actionable information to optimize the therapy for patients afflicted with glaucoma.

Simple stickers may save lives of heart patients

Simple stickers may save lives of heart patients

Researchers have created wearable electronic devices that can monitor the health status of patients at home after heart surgery.

Wireless pliable micro-batteries power wearables

Wireless pliable micro-batteries power wearables

Pliable micro-batteries adapt to the specific material and deliver the power for sensors to collect measurement data from our bodies.

Sensors in the shoe help with postural damage

Sensors in the shoe help with postural damage

Engineers use carbon nanotube composite coatings for novel sensors that could enable smart textiles.

Popular articles

Subscribe to Newsletter