ImFusion uses deep learning to turn 2D ultrasound data into 3D images.
ImFusion uses deep learning to turn 2D ultrasound data into 3D images.
Source: NVIDIA

NVIDIA Healthcare 2.0 – Developing and deploying AI in healthcare

With the right tools, physicians could transform the lives of their patients and scientists the future of medical research. For Kimberly Powell, Vice President of Healthcare at NVIDIA, artificial intelligence is such a tool, and it could meet the increasing demand for personalized medicine and next-generation clinics. “AI is the biggest technological breakthrough of our lifetime. It will boost the entire healthcare ecosystem and will eventually re-invent the way we deliver medicine entirely.”

Report: Sascha Keutel

NVIDIA has been contributing to the field of healthcare for twelve years so far, concentrating the first few years on building technology used in medical instruments and life sciences applications like molecular dynamics simulation and drug discovery. Then around 2012 happened what Powell calls the “Big Bang of Modern Artificial Intelligence” that started with a dataset called “ImageNet”. Researchers discovered that with the deep learning algorithms and the big dataset they could create a new computer vision algorithm that was approaching human accuracy. For Powell, “that is what kicked off the modern AI movement.” 

That kind of ‘ImageNet moment’ is happening right now for language, as researchers have made significant breakthroughs on natural language processing (NLP) and natural language understanding. “There was a new critical deep learning architecture that was created, called “Transformer Architecture” which has an uncanny ability to understand the structure of language,” Powell says.

There is a huge number of use cases for NLP. It can be used for the identification of medical imaging data, for labelling medical imaging data by reading the patient’s electronic health records (EHR) and having it understand what is pictured in the image and putting a circle around the lung nodules that is detected as cancer. “NLP technique will unlock the power of that data and will change our insights into the data we’ve been collecting over the last decade in healthcare records, published research and clinical trials.” 

The healthcare strategy

Photo
Personalized medicine with the help of artificial intelligence.
Source: NVIDIA

In what Powell calls the “NVIDIA Healthcare 2.0”, the company plans to spread AI capabilities in the healthcare industry and to make it easy to adopt these algorithms for any medical discipline. “We do not envision bringing healthcare applications on the market ourselves. Our goal is to empower the ecosystem that exists, whether they are companies that build devices or insurance companies, so that they can build an AI that enabled them to deliver value to healthcare,” Powell states.

The mission is to take the AI breakthroughs and enable them to domain specific applications in healthcare. For that, NVIDIA built a platform called “Clara” which is essentially the AI computational engine for healthcare. “We started in medical imaging and we have now built a tool kit for helping to develop and deploy AI algorithms. We use AI to assist in labelling the data, we offer training workflows for efficiently training on labeled data and have a way to effectively deploy the algorithms to practically any endpoint.” Clara Medical Imaging works on graphics processing unit (GPU) anywhere. It could be embedded into an instrument, in a hospital data center or in any cloud. “That is one unique benefit of our technology: it has the capability of being deployed anywhere it’s needed. It’s not forced to be on a cloud where it could be problematic with patient data,” Powell explains.

In addition, NVIDIA introduced “Clara Genomics” a few months back. “There is a lot of disruptive innovation happening in the area of genomics, one of them is the so-called ‘third generation sequencing technology’ or ‘long read sequencing’,” Powell explains. “The instruments are creating so much data the research community needs rapid analysis tools to minimize the movement and storage of huge genomics data. What we’re working on is to find solutions on how we can assist the analysis of that data.”

Federated learning makes it possible for AI algorithms to gain experience from...
Federated learning makes it possible for AI algorithms to gain experience from a vast range of data located at different sites.
Source: NVIDIA

Partnerships with business and academics

The Clara application framework is NVIDIAs contributions to this critical AI moment in healthcare. “We will continuously integrate the state-of-the-art AI techniques used by internet providers and NVIDIA’s autonomous driving to create a large body of tools that will enable the healthcare industry to innovate and adopt this powerful technology.”

NVIDIA is already working with various partners in adopting AI for their products. For example, Siemens Healthineers is using a NVIDIA GPU-based supercomputing infrastructure to develop AI software to generate organ segmentations that enable precision radiation therapy. Furthermore, Siemens’ Sherlock AI supercomputer which is used to run more than 500 AI experiments daily, is also powered by NVIDIA technology.

However, NVIDIA is not only working with the industry, but also with academic and research institutions. They are collaborating with the King’s College London to bring AI in medical imaging to the point of care. In another project, they are applying ‘federated learning’ to algorithm development, allowing algorithms to be developed on site, using data from the local institutions, without the need for data to travel outside of its own domain. The work could lead to breakthroughs in classifying stroke and neurological impairments, determining the underlying causes of cancers, as well as recommending the best treatment for patients.

Changes for healthcare ecosystem

Photo
Kimberly Powell, Vice President of Healthcare at NVIDIA.
Source: NVIDIA

According to Powell, AI algorithms and workflows will create new opportunities for the both new and existing healthcare companies over the coming decades. “AI is writing software and it improves by seeing more data or by being corrected by the human using it”, Powell explains and adds: “For me, that is a huge opportunity for the large healthcare companies to really re-invent themselves. Continuous integration of AI technology presents a lot of new business model opportunity for software and services.”

Speaking about upcoming changes, Powell also addressed the predictions that AI could be used to one day completely replace physicians. “To me, it’s crazy for people to think that jobs will be replaced because we are already at a huge personnel deficit. If anything, the physician should really think about that AIs will empower them to work on the hard stuff that they trained their whole life to work on: changing the trajectory of a patient’s clinical pathway. We should think about how to use AI to facilitate and optimise their workflow so that they can focus on the patient.” 


Profile:
Kimberly Powell received a B.S. in electrical engineering with a concentration in computer engineering from Northeastern University. She joined NVIDIA in 2008 with responsibility for establishing NVIDIA GPUs as the accelerator platform for medical imaging instruments. As Vice President of Healthcare, Powell is responsible for NVIDIA’s worldwide healthcare business, including hardware and software platforms for accelerated computing, AI and visualization that power the ecosystem of medical imaging, life sciences, drug discovery and healthcare analytics.


You are a professional from the emtech ecosystem and interested in sharing your tech tale with a guest contribution at Tectales? Just contact us: editorial@tectales.com.

Subscribe to our newsletter

Related articles

The role of surgical 3D printing in hospitals

The role of surgical 3D printing in hospitals

More and more hospitals are entering the world of 3D printing in surgery as decision-makers and surgeons are realising the immense benefits for surgeons and patients alike.

Humanising wearable health technologies

Humanising wearable health technologies

Designer Leah Heiss considers her work as creating “emotional technologies”, i.e. wearable devices based on human-centred design principles. For her, empathy is everything!

9 disinfection robots fighting the coronavirus

9 disinfection robots fighting the coronavirus

Surfaces contaminated with SARS-CoV-2 pose a grave threat to the safety of staff and patients. To minimize the risks for their staff, hospitals are utilizing disinfection robots to sanitize surfaces.

Digital transformation: From sick care to proactive health care

Digital transformation: From sick care to proactive health care

“The digital transformation will make healthcare even more human. It will enable us to provide preventive and personalized healthcare!”


VR and lightweight robot simulate hip replacement

VR and lightweight robot simulate hip replacement

Researchers have developed a HIPS, the worldwide first Virtual Reality training simulator for hip replacement surgery.

AI in healthcare – hype, hope and reality

AI in healthcare – hype, hope and reality

Currently, we are too focused on the topic of AI. In order, however, to leverage AI technology several challenges have to be mastered and a proper framework has to be established.

ELSAH – A ‘Smart Patch’ to determine biomarkers

ELSAH – A ‘Smart Patch’ to determine biomarkers

At the start of 2019 the EU project ELSAH began with the objective of designing a wearable within four years that enables the continuous determination of biomarker concentrations.

From TechGiants to HealthTechGiants?

From TechGiants to HealthTechGiants?

Alphabet, Amazon, Apple and Microsoft are all building technologies that have the potential to transform the delivery of care. Here are some examples of BigTech's road into healthcare.

AI in healthcare – hype, hope and reality

AI in healthcare – hype, hope and reality

Currently, we are too focused on the topic of AI. In order, however, to leverage AI technology several challenges have to be mastered and a proper framework has to be established.

Popular articles