DBScan analysis being performed a mature neuron in a typical vLUME workspace.
DBScan analysis being performed a mature neuron in a typical vLUME workspace.
Source: Alexandre Kitching

VR allows scientists to 'walk' inside cells

Virtual reality software which allows researchers to 'walk' inside and analyse individual cells could be used to understand fundamental problems in biology and develop new treatments for disease.

The software, called vLUME, was created by scientists at the University of Cambridge and 3D image analysis software company Lume VR Ltd. It allows super-resolution microscopy data to be visualised and analysed in virtual reality, and can be used to study everything from individual proteins to entire cells. 

Super-resolution microscopy, which was awarded the Nobel Prize for Chemistry in 2014, makes it possible to obtain images at the nanoscale by using clever tricks of physics to get around the limits imposed by light diffraction. This has allowed researchers to observe molecular processes as they happen. However, a problem has been the lack of ways to visualise and analyse this data in three dimensions. "Biology occurs in 3D, but up until now it has been difficult to interact with the data on a 2D computer screen in an intuitive and immersive way," said Dr Steven F. Lee from Cambridge's Department of Chemistry, who led the research. "It wasn't until we started seeing our data in virtual reality that everything clicked into place."

The vLUME project started when Lee and his group met with the Lume VR founders at a public engagement event at the Science Museum in London. While Lee's group had expertise in super-resolution microscopy, the team from Lume specialised in spatial computing and data analysis, and together they were able to develop vLUME into a powerful new tool for exploring complex datasets in virtual reality.

"vLUME is revolutionary imaging software that brings humans into the nanoscale," said Alexandre Kitching, CEO of Lume. "It allows scientists to visualise, question and interact with 3D biological data, in real time all within a virtual reality environment, to find answers to biological questions faster. It's a new tool for new discoveries."

Viewing data in this way can stimulate new initiatives and ideas. For example, Anoushka Handa - a PhD student from Lee's group - used the software to image an immune cell taken from her own blood, and then stood inside her own cell in virtual reality. "It's incredible - it gives you an entirely different perspective on your work," she said.

Spectrin scaffold in neurons (Leterrier Lab, Marseille, France) imaged in...
Spectrin scaffold in neurons (Leterrier Lab, Marseille, France) imaged in vLume, coloured in z direction. Mature neurons (35 days in culture) were fixed and labeled with an anti-beta2-spectrin primary antibody, then an anti-mouse secondary antibody coupled to Alexa Fluor 647.
Source: Alexandre Kitching

The software allows multiple datasets with millions of data points to be loaded in and finds patterns in the complex data using in-built clustering algorithms. These findings can then be shared with collaborators worldwide using image and video features in the software. "Data generated from super-resolution microscopy is extremely complex," said Kitching. "For scientists, running analysis on this data can be very time consuming. With vLUME, we have managed to vastly reduce that wait time allowing for more rapid testing and analysis."

The team are mostly using vLUME with biological datasets, such as neurons, immune cells or cancer cells. For example, Lee's group has been studying how antigen cells trigger an immune response in the body. "Through segmenting and viewing the data in vLUME, we've quickly been able to rule out certain hypotheses and propose new ones," said Lee. This software allows researchers to explore, analyse, segment and share their data in new ways. All you need is a VR headset."

Details are published in the journal Nature Methods.

Subscribe to our newsletter

Related articles

Using VR to study the neuroscience of hearing

Using VR to study the neuroscience of hearing

Cool tools for scientists: Researchers view cells for hearing in 3D using virtual reality

Intelligent algorithms for movement apps

Intelligent algorithms for movement apps

With LTech, the Lindera Software Development Kit, health tech company Lindera brings innovation and AI technology to the fitness industry.

Neural networks speed up holographic imaging

Neural networks speed up holographic imaging

Researchers have developed a holographic technique that can rapidly reconstruct microscopic images of samples with up to 50-fold acceleration compared to existing methods.

AI makes great microscopes better than ever

AI makes great microscopes better than ever

Machine learning helps some of the best microscopes to see better, work faster, and process more data.

AI makes no-cath forecast

AI makes no-cath forecast

Researchers use AI software to predict coronary artery plaque composition and significance without the risks of invasive procedures.

Molecular networks: VR visualization supports research

Molecular networks: VR visualization supports research

A new VR platform enables the display of huge amounts of data. This can be helpful, for example, when examining rare genetic defects.

DNA robots designed in minutes instead of days

DNA robots designed in minutes instead of days

Someday, scientists believe, tiny DNA-based robots and other nanodevices will deliver medicine inside our bodies, detect the presence of deadly pathogens, and help manufacture increasingly smaller electronics.

Using AI to generate 3D holograms in real-time

Using AI to generate 3D holograms in real-time

A new method called tensor holography could enable the creation of holograms for virtual reality, 3D printing, medical imaging, and more — and it can run on a smartphone.

AI, holographic microscopy beat scientists at analyzing immunotherapy​

AI, holographic microscopy beat scientists at analyzing immunotherapy​

AI is helping researchers decipher images from a new holographic microscopy technique needed to investigate a key process in cancer immunotherapy “live” as it takes place.

Popular articles

Subscribe to Newsletter