The Digital Mammography DREAM Challenge involved scientists from around the...
The Digital Mammography DREAM Challenge involved scientists from around the globe to assess whether artificial intelligence can improve the interpretations of mammograms made by radiologists.
Source: Courtesy: Asociación RUVID

AI challenge aims to improve mammography accuracy

Artificial intelligence (AI) techniques, used in combination with the evaluation of expert radiologists, improve the accuracy in detecting cancer using mammograms. This is one of the main conclusions of an international study conducted, among others, by researchers from the Polytechnic University of Valencia (UPV), the Higher Council for Scientific Research (CSIC) and the University of Valencia (UV).

The study is based on the results obtained in the Digital Mammography (DM) DREAM Challenge, an international competition led by IBM where researchers from the Instituto de Física Corpuscular (IFIC, CSIC-UV) have participated along with scientists from the UPV's Institute of Telecommunications and Multimedia Applications (iTEAM).

The team of researchers from IFIC and the iTEAM UPV was the only Spanish group that reached the end of the challenge. To do so, they developed a prediction algorithm based on convolutional neural networks, an Artificial Intelligence technique that simulates the neurons of the visual cortex and allows classifying images, as well as self-learning of the system. Principles related to interpreting x-rays were also applied, where the group has several patents. "Participating in this challenge has allowed our group to collaborate on Artificial Intelligence projects with clinical groups of the Comunidad Valenciana," stated Alberto Albiol, tenured professor at UPV and member of the iTEAM group. "This has opened opportunities for us to apply machine learning techniques, as they are proposed in the article," he added.

For example, the work carried out by Valencian researchers is being carried out in Artemisa, the new computing platform for Artificial Intelligence at the Instituto de Física Corpuscular funded by the European Union and the Generalitat Valenciana within the FEDER operating program of the Comunitat Valenciana for 2014-2020 for the acquisition of R+D+i infrastructures and equipment. "Designing strategies to reduce operating costs of health care is one of the objectives of sustainably applying Artificial Intelligence," pointed out Francisco Albiol, researcher of the IFIC and participant in the study. "The challenges cover from the algorithm part to jointly designing evidence-based strategies along with the medical sector. Artificial Intelligence applied at a large scale is one of the most promising technologies to make health care sustainable," he noted.

The goal of the Digital Mammography (DM) DREAM Challenge is to involve a broad international scientific community (over 1,200 researchers from around the world) to evaluate whether or not Artificial Intelligence algorithms can be equal to or improve the interpretations of the mammograms carried out by radiologists. "This DREAM Challenge allowed carrying out a rigorous and adequate evaluation of dozens of advanced deep learning algorithms in two independent databases," explained Justin Guinney, vice president of Computational Oncology at Sage Bionetworks and president of DREAM Challenges.

A half million fewer mammograms per year in the US

Led by IBM Research, Sage Bionetworks and Kaiser Permanente Washington Research Institute, the Digital Mammography DREAM Challenge concluded that, no algorithm by itself surpassed the radiologists, a combination of methods added to the evaluations of experts improved the accuracy of the exams. Kaiser Permanente Washington (KPW) and the Karolinska Institute (KI) of Sweden provided hundreds of thousands of unidentified mammograms and clinical data. "Our study suggests that a combination of algorithms of artificial intelligence and the interpretations of the radiologists could result in a half million women per year not having to undergo unnecessary diagnostic tests in the United States alone," stated Gustavo Stolovitzky, the director of the IBM program dedicated to Translational Systems Biology and Nanotechnology in the Thomas J. Watson Research Center and founder of DREAM Challenges.

To guarantee the privacy of data and prevent the participants from downloading mammograms with sensitive data, the organizers of the study applied a working system from the model to the data. In the system, participants sent their algorithms to the organizers, who developed a system that applied them directly to the data. "This focus on sharing data is particularly innovative and essential for preserving the privacy of the data," ensured Diana Buist, of the Kaiser Permanente Washington Health Research Institute. "In addition, the inclusion of data from different countries, with different practices for carrying out mammograms, indicates important translational differences in the way in which Artificial Intelligence can be used on different populations."

Mammograms are the most used diagnostic technique for the early detection of breast cancer. Though this detection tool is commonly effective, mammograms must be evaluated and interpreted by a radiologist, who uses their human visual perception to identify signs of cancer. Thus, it is estimated that there are 10% false positives in the 40 million women who undergo scheduled mammograms each year in the United States. "An effective AI algorithm that can increase the radiologist's ability to reduce the repetition of unnecessary tests while detecting clinically significant cancers would help increase the value of mammography detection, effectively improving the damage-benefit ratio," concludes Dr. Christoph Lee of the Washington School of Medicine.

Subscribe to our newsletter

Related articles

AI predicts effectiveness of immunotherapy

AI predicts effectiveness of immunotherapy

Scientists can determine which lung-cancer patients will benefit from expensive immunotherapy.

Combination of AI and radiologists accurately identified breast cancer

Combination of AI and radiologists accurately identified breast cancer

An AI tool identified breast cancer with approximately 90 percent accuracy when combined with analysis by radiologists.

AI improves biomedical imaging

AI improves biomedical imaging

Researchers use artificial intelligence to improve quality of images recorded by a relatively new biomedical imaging method.

AI outperform doctors: Experts express concerns

AI outperform doctors: Experts express concerns

Many studies claiming that AI is as good as (or better than) human experts at interpreting medical images are of poor quality and are arguably exaggerated, warn researchers in The BMJ.

Fighting hand tremors with AI and robots

Fighting hand tremors with AI and robots

Researchers have tapped AI techniques to build an algorithmic model that will make the robots more accurate, faster, and safer when battling hand tremors.

Google-powered AI spots breast cancer

Google-powered AI spots breast cancer

A computer algorithm has been shown to be as effective as human radiologists in spotting breast cancer from x-ray images.

Ensembling improves machine learning model performance

Ensembling improves machine learning model performance

Ensembles created using models submitted to the RSNA Pediatric Bone Age Machine Learning Challenge convincingly outperformed single-model prediction of bone age.

Video game to treat children with ADHD

Video game to treat children with ADHD

Researchers have developed advanced brain-computer interface technology that harnesses machine learning to personalise brain-training for children with ADHD.

Advanced AI boosts clinical analysis of eye images

Advanced AI boosts clinical analysis of eye images

Based on a convolutional neural network the tool is able to provide results within seconds, thus supporting the doctor with comprehensive image analysis.

Popular articles