Researchers used Microsoft HoloLens to visualize, access pathways in human...
Researchers used Microsoft HoloLens to visualize, access pathways in human brain.
Source: Case Western Reserve

Building the first holographic brain ‘atlas

A team of researchers, led by Case Western Reserve University scientists and technicians using the Microsoft HoloLens mixed reality platform, has created what is believed to be the first interactive holographic mapping system of the axonal pathways in the human brain.

The project, described by researchers as a “blending of advanced visualization hardware, software development and neuroanatomy data,” is expected to have a wide range of scientific, clinical and educational applications and further a collaborative interaction between neuroanatomists and brain-imaging scientists.

For starters, it almost instantly becomes “the foundation for a new holographic neurosurgical navigation system” for Deep Brain Stimulation (DBS) and is being dubbed “HoloDBS’ by the team, said lead researcher Cameron McIntyre, the Tilles-Weidenthal Professor of Biomedical Engineering at the Case Western Reserve University School of Medicine. “More than 100 clinicians have had a chance to beta test this so far and the excitement around the technology has been exceptional,” McIntyre said, adding that the method is already dramatically advancing scientists’ understanding of the complexities associated with certain, targeted brain surgeries.

Building the first holographic brain ‘atlas

The new research incorporates decades of valuable, but disconnected, neural data from dozens of sources and transforms them into a fully three-dimensional and interactive visualization. Users of the technology, including neural engineers, neuroanatomists, neurologists, and neurosurgeons, are able to see both the animated “atlas” of the brain via the HoloLens headset—and the axonal connections in front of them.

“The cool thing about this is that we have been able to integrate decades of neuro-anatomical knowledge into the context of the most modern brain visualization techniques,” McIntyre said. “We’re taking all of that anatomical knowledge and putting it into the hands of users in an entirely new and useful format.

McIntyre worked alongside radiology professor Mark Griswold, who is faculty leader of Microsoft HoloLens education-related initiatives and directs the Interactive Commons, a university-wide entity that aims to help faculty, staff and students use a range of visualization technologies to enhance teaching and research. Griswold also led the team that developed the HoloAnatomy app.

A holographic image of the human brain.
A holographic image of the human brain.
Source: Case Western Reserve University

Project details

The project focuses on visualizing the precise axon pathways in the brain. Axon pathfinding is a subfield of neural development which researches how neurons send out axons to reach the correct targets in the brain.

Researchers focused on the subthalamic region of the brain, a common surgical target for deep brain stimulation, but an area of the brain that has been highly problematic for the current best technology, known as tractographic reconstructions. Tractography, known for revealing colorful “brainbows” inside the human brain, has been used in hospitals for about 20 years. It visually represents the nerve tracts in the brain by using data collected by diffusion MRI, presenting the information in two- and three-dimensional images called tractograms.

The Case Western Reserve team advanced that technology not only by making it truly three-dimensional, but interactive by asking a group of expert neuroanatomists to “interactively define axonal trajectories of the cortical, basal ganglia, and cerebellar systems” while wearing the HoloLens headset. “In doing so, we have produced what is the first anatomically realistic model of the major axonal pathways in the human subthalamic region,” McIntyre said. “This is just the first step and can be repeated throughout the brain.”

Subscribe to our newsletter

Related articles

Holographic images increase neurosurgeons performance

Holographic images increase neurosurgeons performance

Researchers have developed a new technique of external ventricular drain insertion that involves the use of a mixed-reality holographic computer headset.

Multimodal mixed reality visualisation for surgical guidance

Multimodal mixed reality visualisation for surgical guidance

Researchers have developed a MR visualisation platform which projects multiple imaging modalities to assist intraoperative surgical guidance.

'Plug and play' brain prosthesis demoed in paralyzed person

'Plug and play' brain prosthesis demoed in paralyzed person

Researchers have shown that machine learning techniques helped an individual with paralysis learn to control a computer cursor using their brain activity.

VR training improves physical and cognitive functions

VR training improves physical and cognitive functions

Researchers have developed an innovative training protocol that, utilizing immersive virtual reality (IVR), leads to real physical and cognitive benefits.

BCI training reduces phantom limb pain

BCI training reduces phantom limb pain

Scientists used brain-computer-interface to train the brains of patients to reduce phantom-hand pain.

Using holograms during cardiac procedure

Using holograms during cardiac procedure

Physicians have shown that using a holographic display improves physician accuracy when performing a procedure to treat irregular heartbeat.

Progress in capture of biosignals for EEG

Progress in capture of biosignals for EEG

New electrode technology and AI analytics solve challenges in neurological emergency, acute and intensive care medicine.

Ocutrx unveiled 8K AR surgery system

Ocutrx unveiled 8K AR surgery system

Ocutrx Vision Technologies has released a new system that provides the most modern options for surgery visualization designed to make it easier for surgeons to perform procedures.

VR study: our visual world of color is incorrect

VR study: our visual world of color is incorrect

A study finds that people are aware of surprisingly limited color in their peripheral vision; much of our sense of a colorful visual world is likely constructed by our brain.

Popular articles