Researchers used Microsoft HoloLens to visualize, access pathways in human...
Researchers used Microsoft HoloLens to visualize, access pathways in human brain.
Source: Case Western Reserve

Building the first holographic brain ‘atlas

A team of researchers, led by Case Western Reserve University scientists and technicians using the Microsoft HoloLens mixed reality platform, has created what is believed to be the first interactive holographic mapping system of the axonal pathways in the human brain.

The project, described by researchers as a “blending of advanced visualization hardware, software development and neuroanatomy data,” is expected to have a wide range of scientific, clinical and educational applications and further a collaborative interaction between neuroanatomists and brain-imaging scientists.

For starters, it almost instantly becomes “the foundation for a new holographic neurosurgical navigation system” for Deep Brain Stimulation (DBS) and is being dubbed “HoloDBS’ by the team, said lead researcher Cameron McIntyre, the Tilles-Weidenthal Professor of Biomedical Engineering at the Case Western Reserve University School of Medicine. “More than 100 clinicians have had a chance to beta test this so far and the excitement around the technology has been exceptional,” McIntyre said, adding that the method is already dramatically advancing scientists’ understanding of the complexities associated with certain, targeted brain surgeries.

Building the first holographic brain ‘atlas

The new research incorporates decades of valuable, but disconnected, neural data from dozens of sources and transforms them into a fully three-dimensional and interactive visualization. Users of the technology, including neural engineers, neuroanatomists, neurologists, and neurosurgeons, are able to see both the animated “atlas” of the brain via the HoloLens headset—and the axonal connections in front of them.

“The cool thing about this is that we have been able to integrate decades of neuro-anatomical knowledge into the context of the most modern brain visualization techniques,” McIntyre said. “We’re taking all of that anatomical knowledge and putting it into the hands of users in an entirely new and useful format.

McIntyre worked alongside radiology professor Mark Griswold, who is faculty leader of Microsoft HoloLens education-related initiatives and directs the Interactive Commons, a university-wide entity that aims to help faculty, staff and students use a range of visualization technologies to enhance teaching and research. Griswold also led the team that developed the HoloAnatomy app.

A holographic image of the human brain.
A holographic image of the human brain.
Source: Case Western Reserve University

Project details

The project focuses on visualizing the precise axon pathways in the brain. Axon pathfinding is a subfield of neural development which researches how neurons send out axons to reach the correct targets in the brain.

Researchers focused on the subthalamic region of the brain, a common surgical target for deep brain stimulation, but an area of the brain that has been highly problematic for the current best technology, known as tractographic reconstructions. Tractography, known for revealing colorful “brainbows” inside the human brain, has been used in hospitals for about 20 years. It visually represents the nerve tracts in the brain by using data collected by diffusion MRI, presenting the information in two- and three-dimensional images called tractograms.

The Case Western Reserve team advanced that technology not only by making it truly three-dimensional, but interactive by asking a group of expert neuroanatomists to “interactively define axonal trajectories of the cortical, basal ganglia, and cerebellar systems” while wearing the HoloLens headset. “In doing so, we have produced what is the first anatomically realistic model of the major axonal pathways in the human subthalamic region,” McIntyre said. “This is just the first step and can be repeated throughout the brain.”

Subscribe to our newsletter

Related articles

Holographic images increase neurosurgeons performance

Holographic images increase neurosurgeons performance

Researchers have developed a new technique of external ventricular drain insertion that involves the use of a mixed-reality holographic computer headset.

“XR is fusing surgical reality with medical images”

“XR is fusing surgical reality with medical images”

Egidijus Pelanis, a medical doctor at Oslo University Hospital, explains how extended realities is applied in the operating room.

Mixed reality enhances brain surgery

Mixed reality enhances brain surgery

A research program explores the use of mixed reality for enabling surgeons to identify brain tumors quickly and precisely.

Multimodal mixed reality visualisation for surgical guidance

Multimodal mixed reality visualisation for surgical guidance

Researchers have developed a MR visualisation platform which projects multiple imaging modalities to assist intraoperative surgical guidance.

Making imagined speech audible

Making imagined speech audible

With a speech neuroprosthetic, imagined speech can be made acoustically audible.

Different affections of VR

Different affections of VR

While very little is known on the effects of immersive VR on adults, there is next to no knowledge on the impact of such systems on the sensorimotor abilities of young children.

The application of XR in mental health care

The application of XR in mental health care

The past two decades have witnessed the emergence of extended reality as a tool for investigation, assessment, and management in mental healthcare.

Virtual reality used in creative arts therapies

Virtual reality used in creative arts therapies

Virtual reality is an emerging as a tool in creative arts therapies. Now, researchers examined the differences in prefrontal cortex activation between two distinct drawing tasks in VR.

Tactile holograms could help train surgeons

Tactile holograms could help train surgeons

Engineers have developed a new way to create the sensation of physically interacting with holographic projections.

Popular articles

Subscribe to Newsletter