Machine learning could enhance scientific peer review

Researchers make the case that Artificial Intelligence tools have the potential to help researchers separate the wheat from the chaff.

Photo
Tudor Oprea, professor of Medicine and Pharmaceutical Sciences and chief of the UNM Division of Translational Informatics.
Source: University of New Mexico

As the COVID-19 pandemic has swept the world, researchers have published hundreds of papers each week reporting their findings—many of which have not undergone a thorough peer review process to gauge their reliability.

In some cases, poorly validated research has massively influenced public policy, as when a French team reported COVID patients were cured by a combination of hydroxychloroquine and azithromycin. The claim was widely publicized, and soon U.S. patients were prescribed these drugs under an emergency use authorization. Further research involving larger numbers of patients has cast serious doubts on these claims, however.

With so much COVID-related information being released each week, how can researchers, clinicians and policymakers keep up? In a commentary published in Nature Biotechnology, University of New Mexico scientist Tudor Oprea, MD, Ph.D., and his colleagues, many of whom work at AI companies, make the case that AI and machine learning have the potential to help researchers separate the wheat from the chaff.

Oprea, professor of Medicine and Pharmaceutical Sciences and chief of the UNM Division of Translational Informatics, notes that the sense of urgency to develop a vaccine and devise effective treatments for the coronavirus has led many scientists to bypass the traditional peer review process by publishing "preprints"—preliminary versions of their work—online.

While that enables rapid dissemination of new findings, "The problem comes when claims about certain drugs that have not been experimentally validated appear in the preprint world," Oprea says. Among other things, bad information may lead scientists and clinicians to waste time and money chasing blind leads.

AI and machine learning can harness massive computing power to check many of the claims that are being made in a research paper, the suggest the authors, a group of public and private-sector researchers from the U.S., Sweden, Denmark, Israel, France, the United Kingdom, Hong Kong, Italy and China led by Jeremy Levin, chair of the Biotechnology Innovation Organization, and Alex Zhavoronkov, CEO of InSilico Medicine.

"I think there is tremendous potential there," Oprea says. "I think we are on the cusp of developing tools that will assist with the peer review process."

Although the tools are not fully developed, "We're getting really, really close to enabling automated systems to digest tons of publications and look for discrepancies," he says. "I am not aware of any such system that is currently in place, but we're suggesting with adequate funding this can become available."

Text mining, in which a computer combs through millions of pages of text looking for specified patterns, has already been "tremendously helpful," Oprea says. "We're making progress in that."

Since the COVID epidemic took hold, Oprea himself has used advanced computational methods to help identify existing drugs with potential antiviral activity, culled from a library of thousands of candidates. "We're not saying we have a cure for peer review deficiency, but we are saying that that a cure is within reach, and we can improve the way the system is currently implemented," he says. "As soon as next year we may be able to process a lot of these data and serve as additional resources to support the peer review process."

Subscribe to our newsletter

Related articles

Network medicine makes drug repurposing effective

Network medicine makes drug repurposing effective

Artificial intelligence can increase the effectiveness of drug repositioning or repurposing research.

5 ways AI is used against COVID-19

5 ways AI is used against COVID-19

Find out more about how scientists and physician are using AI to make contributions in the fight against the coronavirus.

'Deep tech' can help coronavirus response – but there's resistance

'Deep tech' can help coronavirus response – but there's resistance

The development of new medical technologies based on cutting-edge discoveries has accelerated during the coronavirus pandemic.

AI finds COVID-19 needles in a coronavirus haystack

AI finds COVID-19 needles in a coronavirus haystack

Scientists have assembled a combination of data mining, machine-learning algorithms and compression-based analytics to bring the most useful data to the fore on an office computer.

AI tool speeds up COVID-19 research

AI tool speeds up COVID-19 research

Computer scientists are aiming to speed up treatments and vaccines for COVID-19 — by making researchers’ jobs easier.

Using machine learning to estimate COVID-19’s seasonal cycle

Using machine learning to estimate COVID-19’s seasonal cycle

Scientists are launching a project to apply machine learning methods to assess the role of climate variables in disease transmission

AI enables fast-track review of COVID-19 research proposals

AI enables fast-track review of COVID-19 research proposals

An AI tool to help funders identify specialists to peer-review proposals for emergency COVID-19 research has been developed.

AI challenge aims to improve mammography accuracy

AI challenge aims to improve mammography accuracy

AI techniques, used in combination with the evaluation of expert radiologists, improve the accuracy in detecting cancer using mammograms.

Arthritis: AI eliminates unnecessary treatments for children

Arthritis: AI eliminates unnecessary treatments for children

A machine learning algorithm was able to sort children with arthritis into distinct categories based on their patterns of inflamed joints in the body in a way that was also predictive of disease outcome.

Popular articles