ProjectDR is an augmented reality system that allows medical images such as CT...
ProjectDR is an augmented reality system that allows medical images such as CT scans and MRI data to be displayed directly on a patient’s body in a way that moves as the patient does.

AR lets doctors see under patients’ skin

New augmented reality technology lets clinicians see patients’ internal anatomy displayed right on the body. The system, called ProjectDR, allows medical images such as CT scans and MRI data to be displayed directly on a patient’s body in a way that moves as the patient does. “We wanted to create a system that would show clinicians a patient’s internal anatomy within the context of the body,” explained Ian Watts, a computing science graduate student and the developer of ProjectDR.

The technology includes a motion-tracking system using infrared cameras and markers on the patient’s body, as well as a projector to display the images. But the really difficult part, Watts explained, is having the image track properly on the patient’s body even as they shift and move. The solution: custom software written by Watts that gets all of the components working together. “There are lots of applications for this technology, including in teaching, physiotherapy, laparoscopic surgery and even surgical planning,” said Watts, who developed the technology with fellow graduate student Michael Fiest. ProjectDR also has the capacity to present segmented images—for example, only the lungs or only the blood vessels—depending on what a clinician is interested in seeing.

For now, Watts is working on refining ProjectDR to improve the system’s automatic calibration and to add components such as depth sensors. The next steps are testing the program’s viability in a clinical setting, explained Pierre Boulanger, professor in the Department of Computing Science. “Soon, we’ll deploy ProjectDR in an operating room in a surgical simulation laboratory to test the pros and cons in real-life surgical applications,” said Boulanger. “We are also doing pilot studies to test the usability of the system for teaching chiropractic and physical therapy procedures.” added Greg Kawchuk, a co-supervisor on the project from the Faculty of Rehabilitation Medicine. Once these pilot studies are complete, the research team expects the deployment of the system in real surgical pilot studies will quickly follow.

Subscribe to our newsletter

Related articles

Augmented Reality in the OR: matching man and machine

Augmented Reality in the OR: matching man and machine

One of the crucial future technologies in surgery is Augmented Reality. Most experts agree that AR will increase safety and efficiency, improve surgical training and decrease costs.

Eye surgery: Gaining insights through AR

Eye surgery: Gaining insights through AR

Eye surgery is a delicate and precise process. A new simulation platform based on augmented reality allows surgeons to practice surgical procedures on a virtual model in three dimensions.

Promising applications of mixed realities in medicine

Promising applications of mixed realities in medicine

At ECR 2019, researchers talked about the practical applications of mixed realities in medical education and training as well as preprocedural planning and visualization during a surgery.

Digital cadavers transform medical education

Digital cadavers transform medical education

Seemingly out of science fiction, the virtual dissection table brings the future of gross anatomy and clinical science education to real life.

Using VR to study the neuroscience of hearing

Using VR to study the neuroscience of hearing

Cool tools for scientists: Researchers view cells for hearing in 3D using virtual reality

Artificial intelligence betters holographic displays

Artificial intelligence betters holographic displays

Researchers are developing new techniques for improving 3D displays for virtual and augmented reality technologies.

Neural network predicts eye movements

Neural network predicts eye movements

Scientists develop a software that can be used in combination with MRI data for research and diagnosis.

The application of XR in mental health care

The application of XR in mental health care

The past two decades have witnessed the emergence of extended reality as a tool for investigation, assessment, and management in mental healthcare.

Cyber-physical organ twins to train surgeons

Cyber-physical organ twins to train surgeons

Researchers have developed a range of artificial organ phantoms to serve as training platforms for surgeons.

Popular articles

Subscribe to Newsletter