Picking up a delicate item — like this blueberry — without squishing it is...
Picking up a delicate item — like this blueberry — without squishing it is hard for a robot, but researchers at CMU and Meta AI hope to change that through a new tactile sensing skin called ReSkin.
Source: Carnegie Mellon University

ReSkin helps to discover a sense of touch

Carnegie Mellon University and Meta AI (formerly Facebook AI) want to increase the sense of touch in robotics, wearables, smart clothing and AI.

Picking up a blueberry or grape without squishing it isn't hard, but try teaching it to a robot. The same goes for walking on ice, turning a key to unlock a door or cooking a favorite dish.

When it comes to the senses, touch remains a challenge for artificial intelligence and robotics researchers. Carnegie Mellon University and Meta AI (formerly Facebook AI) hope to change that through a new tactile sensing skin they believe will increase the sense of touch in robotics, wearables, smart clothing and AI. Called ReSkin, the technology is affordable, durable and easy-to-use. It harnesses advances in machine learning, soft robotics and magnetic sensing to create a skin that is versatile and as easy to apply as a bandage.

"I want this sensing skin to be so robust and simple that anyone could set it up and start gathering touch data within a day," said Tess Hellebrekers, a postdoctoral researcher at Meta AI.

Abhinav Gupta, an associate professor in the RI and the research manager at Meta AI who worked with Hellebrekers on ReSkin, said the technology could lead to an explosion of possible applications for tactile sensing. It will provide rich contact data for touch-based tasks like determining what something is, sensing movement and grasping an object. This could help in health care or in areas where dexterity to maneuver small, soft or sensitive objects is critical.

ReSkin costs less than $600 for 100 units and even less for larger quantities. It is 2 to 3 millimeters thick and can last for more than 50,000 interactions. Its sensors provide high resolution results and can detect slipping, throwing, catching and clapping. All this makes ReSkin ideal for use on robotic hands, tactile gloves, arm sleeves and even dog shoes, and helps researchers collect data that previously would have been difficult or impossible to gather.

"When it wears out, it can be easily peeled off and replaced with a new one," Gupta said.

ReSkin can easily be replaced because there are no wires between the skin and the sensing board. The sensing board only needs to be nearby. AI methods developed by Raunaq Bhirangi, a Ph.D. student in robotics at CMU and part of the ReSkin team, contribute to its ease of use. These methods enable the sensors to autocalibrate and allow the data to remain consistent even when the skin is replaced. ReSkin requires no hardware or software changes between sensor skins.

"Repeatability and replaceability are two of the biggest bottlenecks hindering widespread use of soft sensors in robotics," Bhirangi said. "With ReSkin, we use simple machine learning techniques to solve these problems and open a scalable and inexpensive tactile sensing module that can be used for a diverse set of applications."

Improvements in computer vision have helped robots and AI see and perceive the world as humans do. Natural language processing has given computers the ability to listen and speak. Touch is another step toward infusing AI and robotics with a sense of what it is like to be human.

"We want AI to understand the richness of the world," Gupta said. "Touch really helps you sense the world in a true form."

ReSkin is part of a broader research initiative by Meta AI into touch and tactile sensing that includes high-resolution tactile hardware, simulators, benchmarks and data sets. Facebook AI hopes improvements in touch unlock possibilities in augmented and virtual reality and lead to innovations in medical, industrial and agricultural robotics.

Subscribe to our newsletter

Related articles

Robotics: Soft pumps power artificial muscles

Robotics: Soft pumps power artificial muscles

Robotic clothing that could help people to move more easily is a step closer to reality thanks to the development of a lightweight power system for soft robotics.

Sensor for smart textiles survives hammers

Sensor for smart textiles survives hammers

An ultra-sensitive, resilient strain sensor that can be embedded in textiles and soft robotic systems survived being tested by a washing machine and a car.

Robotic textiles could enable new mechanotherapy

Robotic textiles could enable new mechanotherapy

A new smart fabric that can be inflated and deflated by temperature-dependent liquid-vapor phase changes could enable a range of medical therapeutics.

A smart orthosis for a stronger back

A smart orthosis for a stronger back

Researchers developed ErgoJack to relieve back strain and encourage workers to execute strenuous movements in a more ergonomic way

Wearable robot enables disabled person to grasp objects

Wearable robot enables disabled person to grasp objects

Scientists have developed a soft wearable hand robot that can aid the hand-disabled by using machine learning algorithm and sensory hardware.

Tiny bubbles help create soft robotics

Tiny bubbles help create soft robotics

Researchers use bubble casting to create soft robotics capable of grabbing and lifting a ball when inflated with air.

New material could help robots flex their muscles

New material could help robots flex their muscles

Researchers have developed a shape memory polymer that stores almost six times more energy than previous versions.

Smart shoe sensors to detect health issues

Smart shoe sensors to detect health issues

A smart shoe with inbuilt sensors could improve the quality of life of older people through the early detection of dementia and diabetic ulcers.

Expanding human-robot collaboration in manufacturing

Expanding human-robot collaboration in manufacturing

To enhance human-robot collaboration, researchers at Loughborough University have trained an AI to detect human intention.

Popular articles

Subscribe to Newsletter