The researchers designed a 3D-printed glove lined with stretchable fiber-optic...
The researchers designed a 3D-printed glove lined with stretchable fiber-optic sensors that use light to detect a range of deformations in real time.
Source: Cornell University

'Skin' sensor gives robots human sensation

Researchers at Cornell University have developed stretchable sensors that gives robots and VirtualReality a human touch.

It's not a stretch to say that stretchable sensors could change the way soft robots function and feel. In fact, they will be able to feel quite a lot. Cornell University researchers have created a fiber-optic sensor that combines low-cost LEDs and dyes, resulting in a stretchable "skin" that detects deformations such as pressure, bending and strain. This sensor could give soft robotic systems—and anyone using augmented reality technology—the ability to feel the same rich, tactile sensations that mammals depend on to navigate the natural world.

The researchers, led by Rob Shepherd, associate professor of mechanical and aerospace engineering, are working to commercialize the technology for physical therapy and sports medicine.

Doctoral student Hedan Bai drew inspiration from silica-based distributed fiber-optic sensors, which detect minor wavelength shifts as a way to identify multiple properties, such as changes in humidity, temperature and strain. However, silica fibers aren’t compatible with soft and stretchable electronics. Intelligent soft systems also present their own structural challenges. “We know that soft matters can be deformed in a very complicated, combinational way, and there are a lot of deformations happening at the same time,” Bai said. “We wanted a sensor that could decouple these.”

SLIMS sensors detect deformations such as pressure, bending and strain, and...
SLIMS sensors detect deformations such as pressure, bending and strain, and pinpoint their exact locations and magnitudes.
Source: Hedan Bai

The researchers designed a 3D printed glove with a SLIMS sensor running along each finger. The glove is powered by a lithium battery and equipped with Bluetooth so it can transmit data to basic software, which Bai designed, that reconstructs the glove's movements and deformations in real time. "Right now, sensing is done mostly by vision," Shepherd said. "We hardly ever measure touch in real life. This skin is a way to allow ourselves and machines to measure tactile interactions in a way that we now currently use the cameras in our phones. It's using vision to measure touch. This is the most convenient and practical way to do it in a scalable way."

Bai and Shepherd are working with Cornell's Center for Technology Licensing to patent the technology, with an eye toward applications in physical therapy and sports medicine. Both fields have leveraged motion-tracking technology but until now have lacked the ability to capture force interactions.

The researchers are also looking into the ways SLIMS sensors can boost virtual and augmented reality experiences. "VR and AR immersion is based on motion capture. Touch is barely there at all," Shepherd said. "Let's say you want to have an augmented reality simulation that teaches you how to fix your car or change a tire. If you had a glove or something that could measure pressure, as well as motion, that augmented reality visualization could say, 'Turn and then stop, so you don't overtighten your lug nuts.' There's nothing out there that does that right now, but this is an avenue to do it."

The research was published in Science.

Subscribe to our newsletter

Related articles

Sensor for smart textiles survives hammers

Sensor for smart textiles survives hammers

An ultra-sensitive, resilient strain sensor that can be embedded in textiles and soft robotic systems survived being tested by a washing machine and a car.

3D printing helps form wearable sensor

3D printing helps form wearable sensor

Researchers have developed a highly sensitive wearable pressure sensor for health monitoring applications and early diagnosis of diseases.

Electronic skin: Intuitive in the virtual reality

Electronic skin: Intuitive in the virtual reality

Scientists have developed the first electronic sensor that can simultaneously process both touchless and tactile stimuli.

Artificial skin could help enhance rehabilitation

Artificial skin could help enhance rehabilitation

Scientists have developed a soft artificial skin that provides haptic feedback and has the potential to instantaneously adapt to a wearer’s movements.

Augmented reality and 3D printing for surgery

Augmented reality and 3D printing for surgery

Researchers are combining virtual reality, augmented reality and 3D printing in order to improve the planning and realization of surgeries.

“Taiwan excellence” at MEDICA 2018

“Taiwan excellence” at MEDICA 2018

At MEDICA 2018, various taiwanese companies showcased a whole range of innovative medical technology such as virtual 3D anatomical models to robotic rehabilitation helpers and smart nappies.

Spray coated tactile sensor for robots and prosthetics

Spray coated tactile sensor for robots and prosthetics

Robots will be able to conduct a wide variety of tasks as well as humans if they can be given tactile sensing capabilities.

Microrobots of metal and plastic

Microrobots of metal and plastic

Researchers have developed a technique for manufacturing micrometre-​long machines by interlocking multiple materials in a complex way.

3D printing strong and tough hydrogels

3D printing strong and tough hydrogels

Skin and cartilage are both strong and flexible – properties that are hard to replicate in artificial materials. But a new fabrication process brings lifelike synthetic polymers a step closer.

Popular articles