Using augmented reality, a surgeon indicates to a first responder the correct...
Using augmented reality, a surgeon indicates to a first responder the correct placement of surgical tools.
Source: Purdue University/Edgar Rojas Muñoz

AR telemedicine effective for battlefield

War zones can be too far from operating rooms, preventing soldiers from receiving the surgery they need fast enough. A Purdue University-led study is the first to show medics successfully performing surgery in life-like simulations of these war zones by receiving guidance from surgeons through an augmented reality headset.

The headset transmits a recorded view of the operating site to the surgeon, who can then use a large-display touch screen to mark up the recording with drawings of how to complete the surgical procedure. Augmented reality helps the first responder see the surgeon’s annotated instructions directly on their view of the operating field.

Researchers at Purdue and the Indiana University School of Medicine have been developing this technology, called System for Telementoring with Augmented Reality (STAR), since 2015.

Operating rooms across the U.S. have already started using augmented reality telementoring to virtually bring in the expertise of other surgeons on how to use a new instrument or better perform a particular procedure.

Photo
In a smoke-filled room, a first responder receives instructions from a surgeon through an augmented reality headset to perform an operation.
Source: Purdue University/Edgar Rojas Muñoz

But this technology hasn’t made it to “austere” settings, such as a battlefield or forest thousands of miles away from a hospital, where a first responder could be treating injuries far too complex for their level of expertise, said Juan Wachs, Purdue University’s James A. and Sharon M. Tompkins Rising Star Associate Professor of Industrial Engineering. “Augmented reality telementoring doesn’t usually operate well in extreme scenarios. Too much smoke can prevent visual sensors from working, for example,” Wachs said.

Researchers from Purdue and the IU School of Medicine tested STAR with first responders and surgeons at the Naval Medical Center Portsmouth in Virginia. The study evaluated first responders using STAR to perform on a patient simulator a common procedure that opens up a blocked airway, called a cricothyroidotomy. Even the responders with no or little experience performing this procedure prior to the study successfully operated after receiving instructions from surgeons through STAR.

The simulations took place both indoors and outdoors, including smoke and sounds of gunshots, explosions and helicopters. The researchers found that first responders more successfully performed the cricothyroidotomies with STAR than with just hearing a surgeon’s voice for each of these scenarios. If smoke made the visualization too unreliable, the responders could still do the operation when STAR automatically switched to audio-only telementoring.

STAR would need more durable materials before it’s used on a real battlefield, Wachs said, but the software is now proven to work in extreme conditions.

The work is published in NPJ Digital Medicine.

Subscribe to our newsletter

Related articles

Augmented Reality in the OR: matching man and machine

Augmented Reality in the OR: matching man and machine

One of the crucial future technologies in surgery is Augmented Reality. Most experts agree that AR will increase safety and efficiency, improve surgical training and decrease costs.

Eye surgery: Gaining insights through AR

Eye surgery: Gaining insights through AR

Eye surgery is a delicate and precise process. A new simulation platform based on augmented reality allows surgeons to practice surgical procedures on a virtual model in three dimensions.

Augmented reality helps to save lives in war zones

Augmented reality helps to save lives in war zones

Researchers use augmented reality tools to connect health care professionals in war zones, natural disasters and in rural areas with more experienced surgeons and physicians around the world.

Smart surgery - from technical fascination to clinical reality

Smart surgery - from technical fascination to clinical reality

Artificial intelligence is developing at an enormous speed and intelligent instruments will profoundly change surgery and medical interventions.

Origami-inspired miniature manipulator for microsurgery

Origami-inspired miniature manipulator for microsurgery

Researchers have developed a surgical robot that improves precision and control of teleoperated surgical procedures.

Wearable haptics make virtual objects feel real

Wearable haptics make virtual objects feel real

Researchers have created soft actuators that can simulate the feeling of touching a virtual object with your fingers.

First AR minimally-invasive spine surgery

First AR minimally-invasive spine surgery

Dr. Frank Phillips, Professor and Director of the Division of Spine Surgery and the Section of Minimally Invasive Spine Surgery at Rush University Medical Center, completed the first augmented reality (AR) minimally invasive spine surgery.

Ocutrx unveiled 8K AR surgery system

Ocutrx unveiled 8K AR surgery system

Ocutrx Vision Technologies has released a new system that provides the most modern options for surgery visualization designed to make it easier for surgeons to perform procedures.

Augmented reality brings ultrasound into a new dimension

Augmented reality brings ultrasound into a new dimension

Augmented reality ultrasound has, for the first time, made it possible to superimpose topographical representations of ultrasound images directly on a patient, with the examiner seeing the sectional image in AR glasses.

Popular articles