Robotic cane brings navigation assistance to 21st century

Equipped with a color 3D camera, an inertial measurement sensor, and its own on-board computer, a newly improved robotic cane could offer blind and visually impaired users a new way to navigate indoors.

Study author Lingqiu Jin tests the robotic cane.
Study author Lingqiu Jin tests the robotic cane.
Source: Cang Ye, VCU

When paired with a building's architectural drawing, the device can accurately guide a user to a desired location with sensory and auditory cues, while simultaneously helping the user avoid obstacles like boxes, furniture, and overhangs. Development of the device was co-funded by the National Institutes of Health's National Eye Institute (NEI) and the National Institute of Biomedical Imaging and Bioengineering (NIBIB).

"Many people in the visually impaired community consider the white cane to be their best and most functional navigational tool, despite it being century-old technology," said Cang Ye, Ph.D., lead author of the study and professor of computer science at the College of Engineering at the Virginia Commonwealth University, Richmond. "For sighted people, technologies like GPS-based applications have revolutionized navigation. We're interested in creating a device that closes many of the gaps in functionality for white cane users."

While there are cell phone-based applications that can provide navigation assistance—helping blind users stay within crosswalks, for example—large spaces inside buildings are a major challenge, especially when those spaces are unfamiliar. Earlier versions of Ye's robotic cane began tackling this problem by incorporating building floorplans; the user could tell the cane whether he or she wished to go, and the cane—by a combination of auditory cues and a robotic rolling tip—could guide the user to their destination. But when used over long distances, the inaccuracies in the user's location could build up, eventually leaving the user at an incorrect location.

To help correct this issue, Ye and colleagues have added a color depth camera to the system. Using infrared light, much like a mobile phone's front-facing camera, the system can determine the distance between the cane and other physical objects, including the floor, features like doorways and walls, as well as furniture and other obstacles. Using this information, along with data from an inertial sensor, the cane's onboard computer can map the user's precise location to the existing architectural drawing or floorplan, while also alerting the user to obstacles in their path.

"While some cell phone apps can give people auditory navigation instructions, when going around a corner for example, how do you know you've turned just the right amount?" said Ye. "The rolling tip on our robotic cane can guide you to turn at just the right point and exactly the right number of degrees, whether it's 15 degrees or 90. This version can also alert you to overhanging obstacles, which a standard white cane cannot."

There are still a few kinks to be worked out before the system will be market-ready—it's still too heavy for regular use, for example, and Ye's team is looking for a way to slim down the device. Nevertheless, with the ability to easily switch between its automated mode and a simpler, non-robotic "white cane mode," Ye believes this device could provide a key independence tool for the blind and visually impaired, without losing the characteristics of the white cane that have stood the test of time.

Details of the updated design were published in IEEE/CAA Journal of Automatica Sinica.

Subscribe to our newsletter

Related articles

DNA robots designed in minutes instead of days

DNA robots designed in minutes instead of days

Someday, scientists believe, tiny DNA-based robots and other nanodevices will deliver medicine inside our bodies, detect the presence of deadly pathogens, and help manufacture increasingly smaller electronics.

AI screens and diagnoses glaucoma

AI screens and diagnoses glaucoma

Scientists have developed a novel method that uses artificial intelligence to screen for glaucoma.

Robotic scanner automates diagnostic imaging in the eye

Robotic scanner automates diagnostic imaging in the eye

Engineers and ophthalmologists have developed a robotic imaging tool that can automatically detect and scan a patient's eyes for markers of different eye diseases.

New law of physics helps robots grasp the friction of touch

New law of physics helps robots grasp the friction of touch

Researchers have discovered a new law of physics that accounts for that accounts for elastohydrodynamic lubrication (EHL) friction, which should advance a wide range of robotic technologies.

A Lego system for building robots

A Lego system for building robots

Scientists have developed a system with which they can fabricate miniature robots building block by building block, which function exactly as required.

Robotics: Soft pumps power artificial muscles

Robotics: Soft pumps power artificial muscles

Robotic clothing that could help people to move more easily is a step closer to reality thanks to the development of a lightweight power system for soft robotics.

Artificial skin brings robots closer to 'touching' human lives

Artificial skin brings robots closer to 'touching' human lives

Researchers have constructed a 3D vision-guided artificial skin that enables tactile sensing with high performance, opening doors to innumerable applications in medicine.

Device rapidly creates 3D images of skin

Device rapidly creates 3D images of skin

A portable 3D printed device produces high-resolution 3D images of human skin within 10 minutes. It could be used to assess the severity of skin conditions.

Smart contact lens to combat eye deficiencies

Smart contact lens to combat eye deficiencies

Researchers have developed an artificial iris integrated inside a contact lens that can automatically set the proper pupil size to achieve optimal focus and depth of field.

Popular articles

Subscribe to Newsletter