AR may assist cardiologists perform complex procedures

Augmented reality (AR) offers a new platform to help physicians better visualize complex medical data, particularly before and during medical procedures. A new self-contained AR device aims to provide an immersive AR experience in which surgeons can interactively explore data in three dimensions.

Photo
Demonstration of the HoloLens 3D LGE during the electroanatomic mapping and radio-frequency ablation of ventricular tachycardia in the pilot animal study.
Source: PLOS ONE

Jihye Jang, a PhD Candidate at the Cardiac Magnetic Resonance (MR) Center at Beth Israel Deaconess Medical Center (BIDMC), and colleagues assessed AR’s potential to help cardiologists visualize myocardial scarring in the heart as they perform ventricular tachycardia ablation or other electrophysiological interventions. Myocardial scarring can occur in people who experience a heart attack and also stems from the surgical repair of congenital heart disease. The team’s findings demonstrate that the new augmented reality technology confers a number of advantages. “Augmented reality allows physicians to superimpose images, such as MRI or CT scans, as a guide during therapeutic intervention,” said Jang. “Our report shows exciting potential that having this complex 3D scar information through augmented reality during the intervention may help guide treatment and ultimately improve patient care. Physicians can now use AR to view 3D cardiac MR information with a touchless interaction in sterile environment.”

Photo
Demonstration of the 3D holographic visualization of the voxel-wise 3D scar rendering and scar projected endocardial surface mesh from 3D LGE data that are generated based on the proposed framework.
Source: PLOS ONE

By projecting three dimensional imagery onto a glass screen worn like a diving mask on the surgeon’s face, AR provides 3D depth perception and allows surgeons to interact with the medical data without physically touching a screen or computer mouse, maintaining a sterile environment and reducing the risk of infection. In Jang and colleague’s pilot study, the researchers applied the augmented reality technique as they generated holographic 3D scar in five animal models that underwent controlled infarction and electrophysiological study.

3D holographic visualization of the scar was performed to assist assessment of the complex 3D scar architecture. An operator and mapping specialist viewed the holographic 3D scar during electrophysiological study, and completed the perceived usefulness questionnaire in the six-item usefulness scale and found it useful to have scar information during the intervention. The user could interactively explore 3D myocardial scar in the augmented reality environment that allows for the combination of holographic 3D LGE data interacting with any real-world environments, such as a surgical suite or patient’s body. “Our report is one of the first efforts to test augmented reality in cardiovascular electrophysiological intervention,” said Jang. “Our next steps will expand the use of AR into treatments for arrhythmia by merging the scar information with electrophysiology data.”

Subscribe to our newsletter

Related articles

“XR is fusing surgical reality with medical images”

“XR is fusing surgical reality with medical images”

Egidijus Pelanis, a medical doctor at Oslo University Hospital, explains how extended realities is applied in the operating room.

Ocutrx unveiled 8K AR surgery system

Ocutrx unveiled 8K AR surgery system

Ocutrx Vision Technologies has released a new system that provides the most modern options for surgery visualization designed to make it easier for surgeons to perform procedures.

Augmented reality helps surgeons to ‘see through’ tissue

Augmented reality helps surgeons to ‘see through’ tissue

A series of procedures have shown how surgeons can use computer-generated augmented reality imaging while operating on patients undergoing reconstructive lower limb surgery.

Artificial intelligence betters holographic displays

Artificial intelligence betters holographic displays

Researchers are developing new techniques for improving 3D displays for virtual and augmented reality technologies.

Tactile holograms could help train surgeons

Tactile holograms could help train surgeons

Engineers have developed a new way to create the sensation of physically interacting with holographic projections.

Mixed reality enhances brain surgery

Mixed reality enhances brain surgery

A research program explores the use of mixed reality for enabling surgeons to identify brain tumors quickly and precisely.

Augmented reality provides insights during liver surgery

Augmented reality provides insights during liver surgery

Researchers are developing 3D technologies for surgeons. The aids for surgery planning are particularly advanced.

Augmented Reality in the OR: matching man and machine

Augmented Reality in the OR: matching man and machine

One of the crucial future technologies in surgery is Augmented Reality. Most experts agree that AR will increase safety and efficiency, improve surgical training and decrease costs.

Using holograms during cardiac procedure

Using holograms during cardiac procedure

Physicians have shown that using a holographic display improves physician accuracy when performing a procedure to treat irregular heartbeat.

Popular articles

Subscribe to Newsletter