Thanks to artificial intelligence, the AIMOS software is able to recognize...
Thanks to artificial intelligence, the AIMOS software is able to recognize bones and organs on three-dimensional grayscale images and segments them, which makes the subsequent evaluation considerably easier.
Source: Astrid Eckert / TUM

Self-learning algorithms analyze imaging data

Imaging techniques enable a detailed look inside an organism. But interpreting the data is time-consuming and requires a great deal of experience. Artificial neural networks open up new possibilities: They require just seconds to interpret whole-body scans of mice and to segment and depict the organs in colors, instead of in various shades of gray. This facilitates the analysis considerably.

How big is the liver? Does it change if medication is taken? Is the kidney inflamed? Is there a tumor in the brain and did metastases already develop? In order to answer such questions, bioscientists and doctors to date had to screen and interpret a wealth of data.

"The analysis of three-dimensional imaging processes is very complicated," explains Oliver Schoppe. Together with an interdisciplinary research team, the TUM researcher has now developed self-learning algorithms to in future help analyze bioscientific image data.

At the core of the AIMOS software—the abbreviation stands for AI-based Mouse Organ Segmentation—are artificial neural networks that, like the human brain, are capable of learning. "You used to have to tell computer programs exactly what you wanted them to do," says Schoppe. "Neural networks don't need such instructions:" It's sufficient to train them by presenting a problem and a solution multiple times. Gradually, the algorithms start to recognize the relevant patterns and are able to find the right solutions themselves."

Training self-learning algorithms

In the AIMOS project, the algorithms were trained with the help of images of mice. The objective was to assign the image points from the 3D whole-body scan to specific organs, such as stomach, kidneys, liver, spleen, or brain. Based on this assignment, the program can then show the exact position and shape.

"We were lucky enough to have access to several hundred image of mice from a different research project, all of which had already been interpreted by two biologists," recalls Schoppe. The team also had access to fluorescence microscopic 3D scans from the Institute for Tissue Engineering and Regenerative Medicine at the Helmholtz Zentrum München.

Through a special technique, the researchers were able to completely remove the dye from mice that were already deceased. The transparent bodies could be imaged with a microscope step by step and layer for layer. The distances between the measuring points were only six micrometers—which is equivalent to the size of a cell. Biologists had also localized the organs in these datasets.

Recommended article

AI improves accuracy

At the TranslaTUM the information techs presented the data to their new algorithms. And these learned faster than expected, Schoppe reports: "We only needed around ten whole-body scans before the software was able to successfully analyze the image data on its own—and within a matter of seconds. It takes a human hours to do this."

The team then checked the reliability of the artificial intelligence with the help of 200 further whole-body scans of mice. "The result shows that self-learning algorithms are not only faster at analyzing biological image data than humans, but also more accurate," sums up Professor Bjoern Menze, head of the Image-Based Biomedical Modeling group at TranslaTUM at the Technical University of Munich.

The intelligent software is to be used in the future in particular in basic research: "Images of mice are vital for, for example, investigating the effects of new medication before they are given to humans. Using self-learning algorithms to analyze image data in the future will save a lot of time in the future," emphasizes Menze.

Subscribe to our newsletter

Related articles

Machine learning algorithm detects early stages of Alzheimer's

Machine learning algorithm detects early stages of Alzheimer's

An artificial intelligence-based detects early stages of Alzheimer’s through functional magnetic resonance imaging.

Neural network can determine lung cancer severity

Neural network can determine lung cancer severity

Researchers have created an artificial neural network that analyzes lung CT scans to provide information about lung cancer severity that can guide treatment options.

COVID-19: AIs shortcuts lead to misdiagnosis

COVID-19: AIs shortcuts lead to misdiagnosis

Researchers discovered that AI models have a tendency to look for shortcuts. In the case of AI-assisted disease detection, these shortcuts could lead to diagnostic errors if deployed in clinical settings.

Integrating imaging with deep neural networks

Integrating imaging with deep neural networks

Neural network framework may increase radiologist's confidence in assessing the type of lung cancer on CT scans, informing individualized treatment planning.

AI identifies 'ugly ducklings' to catch skin cancer

AI identifies 'ugly ducklings' to catch skin cancer

Deep learning-based system enables dermatologist-level identification of suspicious skin lesions from smartphone photos, allowing better screening.

'Liquid' machine learning system adapts to changing conditions

'Liquid' machine learning system adapts to changing conditions

A machine learning system learns on the job. By continuously adapting to new data inputs, this “liquid network” could aid decision-making in medical diagnosis.

Biomedical research: deep learning outperforms machine learning

Biomedical research: deep learning outperforms machine learning

Deep-learning methods have the potential to offer substantially better results, generating superior representations for characterizing the human brain.

AI accurately detects COVID-19 on chest x-rays

AI accurately detects COVID-19 on chest x-rays

Researchers have developed a new AI platform that detects COVID-19 by analyzing X-ray images of the lungs.

Deep learning enables screening for eye disease

Deep learning enables screening for eye disease

Researchers created a novel deep learning method that makes automated screenings for eye diseases such as diabetic retinopathy more efficient.

Popular articles

Subscribe to Newsletter