Using a noninvasive brain-computer interface, scientists have developed the...
Using a noninvasive brain-computer interface, scientists have developed the first successful mind-controlled robotic arm exhibiting the ability to continuously track and follow a computer cursor.
Source: Carnegie Mellon University

A mind-controlled robotic arm without brain implants

A team of researchers from Carnegie Mellon University, in collaboration with the University of Minnesota, has made a breakthrough that could benefit paralyzed patients and those with movement disorders.

Using a noninvasive brain-computer interface (BCI), scientists have developed the first successful mind-controlled robotic arm exhibiting the ability to continuously track and follow a computer cursor.

BCIs have been shown to achieve good performance for controlling robotic devices using only the signals sensed from brain implants. When robotic devices can be controlled with high precision, they can be used to complete a variety of daily tasks. Until now, however, BCIs successful in continuously controlling robotic arms have used invasive brain implants. These implants require a substantial amount of medical and surgical expertise to correctly install and operate, not to mention cost and potential risks to subjects, and as such, their use has been limited to just a few clinical cases.

A grand challenge in BCI research is to develop less invasive or even totally noninvasive technology that would allow paralyzed patients to control their environment or robotic limbs using their own “thoughts.” Such noninvasive BCI technology, if successful, would bring such much needed technology to numerous patients and even potentially to the general population.

However, BCIs that use noninvasive external sensing, rather than brain implants, receive “dirtier” signals, leading to current lower resolution and less precise control. Thus, when using only the brain to control a robotic arm, a noninvasive BCI doesn’t stand up to using implanted devices. Despite this, BCI researchers have forged ahead, their eye on the prize of a less-invasive or noninvasive technology that could help patients everywhere on a daily basis.

Bin He, the Trustee Professor and Head of the Biomedical Engineering Department at Carnegie Mellon, is achieving that goal, one key discovery at a time. “There have been major advances in mind-controlled robotic devices using brain implants. It’s excellent science,” He said. “But noninvasive is the ultimate goal. Advances in neural decoding and the practical utility of noninvasive robotic arm control will have major implications on the eventual development of noninvasive neurorobotics.”

Using novel sensing and machine learning techniques, He and his lab have been able to access signals deep within the brain, achieving a high resolution of control over a robotic arm. With noninvasive neuroimaging and a novel continuous pursuit paradigm, He is overcoming the noisy EEG signals leading to significantly improve EEG-based neural decoding, and facilitating real-time continuous 2D robotic device control.

For the first time, by using a noninvasive BCI to control a robotic arm that’s tracking a cursor on a computer screen, He has shown in human subjects that a robotic arm can now follow the cursor continuously. Whereas robotic arms controlled by humans noninvasively had previously followed a moving cursor in jerky, discrete motions — as though the robotic arm was trying to “catch up” to the brain’s commands — now, the arm follows the cursor in a smooth, continuous path.

In a paper published in Science Robotics, the team established a new framework that addresses and improves upon the “brain” and “computer” components of BCI by increasing user engagement and training, as well as spatial resolution of noninvasive neural data through EEG source imaging. The paper shows the team’s unique approach to solving this problem not only enhanced BCI learning by nearly 60% for traditional center-out tasks, it also enhanced continuous tracking of a computer cursor by over 500%.

The technology also has applications that could help a variety of people, by offering safe, noninvasive “mind control” of devices that can allow people to interact with and control their environments. The technology has, to date, been tested in 68 able-bodied human subjects (up to 10 sessions for each subject), including virtual device control and controlling of a robotic arm for continuous pursuit. The technology is directly applicable to patients, and the team plans to conduct clinical trials in the near future.

“Despite technical challenges using noninvasive signals, we are fully committed to bringing this safe and economic technology to people who can benefit from it,” He said. “This work represents an important step in noninvasive brain-computer interfaces, a technology that someday may become a pervasive assistive technology aiding everyone, like smartphones.”

Subscribe to our newsletter

Related articles

Quadriplegic controls two prosthetics with thoughts

Quadriplegic controls two prosthetics with thoughts

Researchers have enabled a quadriplegic man to control a pair of prosthetic arms with his mind.

Brain-controlled computers are becoming a reality, but major hurdles remain

Brain-controlled computers are becoming a reality, but major hurdles remain

More researchers and companies are moving into the brain-computer interfaces, yet major challenges remain, from user training to the reality of invasive brain implant procedures.

Prostheses could alleviate amputees' phantom limb pain

Prostheses could alleviate amputees' phantom limb pain

New prosthetic technologies that stimulate the nerves could pave the way for prostheses that feel like a natural part of the body and reduce the phantom limb pain commonly endured by amputees.

First use of high-bandwidth wireless brain-computer interface

First use of high-bandwidth wireless brain-computer interface

BrainGate researchers demonstrated the first human use of a wireless transmitter capable of delivering high-bandwidth neural signals.

Enhanced safety and precision with semi-automatic milling systems

Enhanced safety and precision with semi-automatic milling systems

Professor Dr Henning Windhagen is a great fan of semi-automatic systems in the OR that help with implants but leave the surgeon in the driver’s seat.

Exoskeleton and brain-machine interface boost stroke rehab

Exoskeleton and brain-machine interface boost stroke rehab

Researchers have developed a system that combines a brain-computer interface and a robotic arm that responds to the actual intentions of treated patients.

Bionic touch does not remap the brain

Bionic touch does not remap the brain

Neuroscientists have demonstrated that the brain does not remap itself even with long-term bionic limb use, posing challenges for the development of realistic prosthetic limbs.

3D printing strong and tough hydrogels

3D printing strong and tough hydrogels

Skin and cartilage are both strong and flexible – properties that are hard to replicate in artificial materials. But a new fabrication process brings lifelike synthetic polymers a step closer.

Aerogel: the micro structural material of the future

Aerogel: the micro structural material of the future

In a research-first, scientists from Empa were able to 3D print stable well-shaped microstructures made from silica aerogels for use in biotechnology and precision engineering.

Popular articles

Subscribe to Newsletter