Tactile holograms could help train surgeons
Source: University of Glasgow
08.09.2021 •

Tactile holograms could help train surgeons

Engineers from the University of Glasgow have developed a new way to create the sensation of physically interacting with holographic projections.

A piece of science fiction technology could be one step closer to reality with a new development in haptic holograms. The idea of haptic, or touchable, holograms is familiar to millions from its appearance in sci-fi favorites like Star Trek's holodeck, where characters can interact with solid-seeming computer simulations of people, objects and places.

Now, a team of engineers from the University of Glasgow have developed a new way to create the sensation of physically interacting with holographic projections.

The researchers have developed a new technique they call 'aerohaptics." The system pairs volumetric display technology with precisely controlled jets of air to create the sensation of touch on users' hands, fingers and wrists.

The technique could form the basis of new ways to interact with virtual objects, advanced forms of teleconferencing, and even empower surgeons to perform procedures remotely.

The system, developed by the University's Bendable Electronics and Sensing Technologies (BEST) research group, is based around a pseudo-holographic display which uses glass and mirrors to make a two-dimensional image appear to hover in space—a modern variation on a 19th-century illusion technique known as Pepper's Ghost.

It pairs a Leap Motion sensor to track users' hand movements with a moveable air nozzle to direct airflow to their palms and fingertips.

Tactile holograms could help train surgeons
Source: Ravinder Dahiya

In the paper, the team offer an example of how they used the system to create a realistic sensation of bouncing a basketball. With a computer-generated 3D image of a basketball displayed in space, and the Leap Motion sensor tracking the movement and location of the user's hands, the system varies the direction and force of the airflow to create aerohaptic feedback.

The feedback is also modulated based on the virtual surface of the basketball, allowing users to 'feel' the rounded shape of the ball as it rolls from their fingertips when they bounce it and the slap in their palm when it returns. Users can even 'push' the virtual ball with varying force and sense the resulting change in how a hard bounce or a soft bounce feels in their palm.

"Haptic feedback and volumetric display technology has come a long way in recent years, bringing us closer to being able to convincingly interact with virtual objects. However, current haptic tech often still involves wearable or handheld peripherals, which add cost and complication and could be holding back widespread adoption of the technology," Professor Ravinder Dahiya of the University of Glasgow's James Watt School of Engineering said.

Tactile holograms could help train surgeons
Source: Ravinder Dahiya

Dahiya added: "Aerohaptics creates a convincing sensation of physical interaction on users' hands at a relatively low cost. We are already looking in to adding additional functionality to the system, such as adding temperature control to their airflow to deepen the sensation of interacting with hot or cool objects. We believe aerohaptics could form the basis for many new applications in the future, such as creating convincing, interactive 3D renderings of real people for teleconferences. It could help teach surgeons to perform tricky procedures in virtual spaces during their training, or even allow them to command robots to do the surgeries for real. We're looking forward to exploring the possibilities as we continue to develop the system."

The team's paper was published in Advanced Intelligent Systems.

Subscribe to our newsletter

Related articles

“XR is fusing surgical reality with medical images”

“XR is fusing surgical reality with medical images”

Egidijus Pelanis, a medical doctor at Oslo University Hospital, explains how extended realities is applied in the operating room.

Mixed reality enhances brain surgery

Mixed reality enhances brain surgery

A research program explores the use of mixed reality for enabling surgeons to identify brain tumors quickly and precisely.

Multimodal mixed reality visualisation for surgical guidance

Multimodal mixed reality visualisation for surgical guidance

Researchers have developed a MR visualisation platform which projects multiple imaging modalities to assist intraoperative surgical guidance.

Ocutrx unveiled 8K AR surgery system

Ocutrx unveiled 8K AR surgery system

Ocutrx Vision Technologies has released a new system that provides the most modern options for surgery visualization designed to make it easier for surgeons to perform procedures.

AR may assist cardiologists perform complex procedures

AR may assist cardiologists perform complex procedures

AR offers a new platform to help physicians better visualize complex medical data, particularly before and during medical procedures.

Augmented reality helps surgeons to ‘see through’ tissue

Augmented reality helps surgeons to ‘see through’ tissue

A series of procedures have shown how surgeons can use computer-generated augmented reality imaging while operating on patients undergoing reconstructive lower limb surgery.

Robotics expands in spinal surgery

Robotics expands in spinal surgery

Increasing numbers of hospitals and spine surgeons are adopting robotics and computer navigation, which aim to enhance precision, accuracy and predictability.

Neural networks speed up holographic imaging

Neural networks speed up holographic imaging

Researchers have developed a holographic technique that can rapidly reconstruct microscopic images of samples with up to 50-fold acceleration compared to existing methods.

Augmented reality provides insights during liver surgery

Augmented reality provides insights during liver surgery

Researchers are developing 3D technologies for surgeons. The aids for surgery planning are particularly advanced.

Popular articles

Subscribe to Newsletter