Researchers used Microsoft HoloLens to visualize, access pathways in human...
Researchers used Microsoft HoloLens to visualize, access pathways in human brain.
Source: Case Western Reserve

Building the first holographic brain ‘atlas

A team of researchers, led by Case Western Reserve University scientists and technicians using the Microsoft HoloLens mixed reality platform, has created what is believed to be the first interactive holographic mapping system of the axonal pathways in the human brain.

The project, described by researchers as a “blending of advanced visualization hardware, software development and neuroanatomy data,” is expected to have a wide range of scientific, clinical and educational applications and further a collaborative interaction between neuroanatomists and brain-imaging scientists.

For starters, it almost instantly becomes “the foundation for a new holographic neurosurgical navigation system” for Deep Brain Stimulation (DBS) and is being dubbed “HoloDBS’ by the team, said lead researcher Cameron McIntyre, the Tilles-Weidenthal Professor of Biomedical Engineering at the Case Western Reserve University School of Medicine. “More than 100 clinicians have had a chance to beta test this so far and the excitement around the technology has been exceptional,” McIntyre said, adding that the method is already dramatically advancing scientists’ understanding of the complexities associated with certain, targeted brain surgeries.

Building the first holographic brain ‘atlas

The new research incorporates decades of valuable, but disconnected, neural data from dozens of sources and transforms them into a fully three-dimensional and interactive visualization. Users of the technology, including neural engineers, neuroanatomists, neurologists, and neurosurgeons, are able to see both the animated “atlas” of the brain via the HoloLens headset—and the axonal connections in front of them.

“The cool thing about this is that we have been able to integrate decades of neuro-anatomical knowledge into the context of the most modern brain visualization techniques,” McIntyre said. “We’re taking all of that anatomical knowledge and putting it into the hands of users in an entirely new and useful format.

McIntyre worked alongside radiology professor Mark Griswold, who is faculty leader of Microsoft HoloLens education-related initiatives and directs the Interactive Commons, a university-wide entity that aims to help faculty, staff and students use a range of visualization technologies to enhance teaching and research. Griswold also led the team that developed the HoloAnatomy app.

A holographic image of the human brain.
A holographic image of the human brain.
Source: Case Western Reserve University

Project details

The project focuses on visualizing the precise axon pathways in the brain. Axon pathfinding is a subfield of neural development which researches how neurons send out axons to reach the correct targets in the brain.

Researchers focused on the subthalamic region of the brain, a common surgical target for deep brain stimulation, but an area of the brain that has been highly problematic for the current best technology, known as tractographic reconstructions. Tractography, known for revealing colorful “brainbows” inside the human brain, has been used in hospitals for about 20 years. It visually represents the nerve tracts in the brain by using data collected by diffusion MRI, presenting the information in two- and three-dimensional images called tractograms.

The Case Western Reserve team advanced that technology not only by making it truly three-dimensional, but interactive by asking a group of expert neuroanatomists to “interactively define axonal trajectories of the cortical, basal ganglia, and cerebellar systems” while wearing the HoloLens headset. “In doing so, we have produced what is the first anatomically realistic model of the major axonal pathways in the human subthalamic region,” McIntyre said. “This is just the first step and can be repeated throughout the brain.”

Subscribe to our newsletter

Related articles

Holographic images increase neurosurgeons performance

Holographic images increase neurosurgeons performance

Researchers have developed a new technique of external ventricular drain insertion that involves the use of a mixed-reality holographic computer headset.

Multimodal mixed reality visualisation for surgical guidance

Multimodal mixed reality visualisation for surgical guidance

Researchers have developed a MR visualisation platform which projects multiple imaging modalities to assist intraoperative surgical guidance.

Neuroprosthesis decodes speech for paralyzed man

Neuroprosthesis decodes speech for paralyzed man

Researchers have developed a "speech neuroprosthesis" that has enabled a man with severe paralysis to communicate in sentences.

Stereotactic systems from the 3D printer

Stereotactic systems from the 3D printer

Researchers have developed a way of manufacturing stereotactic systems from plastic using a 3D printer – a cost-effective method that opens up new design potential.

Neural networks speed up holographic imaging

Neural networks speed up holographic imaging

Researchers have developed a holographic technique that can rapidly reconstruct microscopic images of samples with up to 50-fold acceleration compared to existing methods.

Using digital twins to help treat multiple sclerosis

Using digital twins to help treat multiple sclerosis

Scientists in Dresden are expanding their digital health expertise in multiple sclerosis (MS) therapy and research with an ambitious scientific project - creating a "digital twin“ from data.

Brain-computer interface turns mental handwriting into text

Brain-computer interface turns mental handwriting into text

Scientists have used an implanted sensor to record the brain signals associated with handwriting, and used those signals to create text on a computer in real time.

Wearable sensors to track Parkinson's symptoms

Wearable sensors to track Parkinson's symptoms

Scientists have developed algorithms that, combined with wearable sensors, could help clinicians to monitor the progression of Parkinson’s disease.

Gamification: fighting dementia with play

Gamification: fighting dementia with play

Cognitive motor training helps in the fight against Alzheimer’s and dementia, as demonstrated for the first time in a study by an international team of researchers .

Popular articles

Subscribe to Newsletter