Smart speakers harnessed for hospital medical treatments

Smart speakers that are customarily used in your living room can be programmed to act as an aid to physicians in hospital operating rooms, according to new research presented at the Society of Interventional Radiology’s 2019 Annual Scientific Meeting.

Photo

Smart speakers, such as the Amazon Echo and Google Home, offer a conversational voice interface that allows interventional radiology (IR) physicians to ask questions and retrieve information needed for their patient treatments without breaking sterile scrub. “During treatment, IRs rely on nuanced medical information delivered in a timely manner. When you’re in the middle of a procedure, you need to remain sterile, so you lose the ability to use a computer,” said Kevin Seals, M.D., a fellow in interventional radiology at the University of California, San Francisco (UCSF) and lead author of the study. “This smart speaker technology helps us to quickly and intelligently make decisions relevant to a patient’s specific needs.”

The researchers at UCSF developed a device-sizing application for the Google Home smart speaker. The application processes questions from a human voice and provides recommendations on the precise sizing of medical devices. For example, if an IR needs to know what size sheath to use to implant a stent in a patient’s blood vessel, the smart speaker can quickly and accurately communicate the correct size based on the specific circumstances, which helps the physician in making a final decision. “There are hundreds of devices, with more being introduced every day, making it difficult to determine the correct sizing or materials needed in every circumstance. This technology allows physicians to concentrate more closely on the care of their patients, devoting less time and mental energy to device technicalities,” said Seals.

In developing the application, size specifications were acquired using literature reviews for 475 IR devices, such as catheters, sheaths, stents, vascular plugs and others. Natural language processing was implemented using Dialogflow, which extracted the information of interest from an input query. Logic operations and other data processing were performed using a Python script deployed to the cloud.

The researchers plan to continue to build on this technology and expand its scope to include information on material costs and inventory databases. Having this information readily available will make treatments more efficient, cost-effective and beneficial to patients. Further research will look to yield information for physicians in other specialties and provide information from electronic health records and patient clinical data, such as allergies or prior surgeries.

Subscribe to our newsletter

Related articles

Sony’s smart OR platform gains FDA clearance

Sony’s smart OR platform gains FDA clearance

Sony Electronics has received clearance for the company's NUCLeUS™ Operating Room, Imaging Management and Collaboration Control platform.

Smart glasses provide fluoroscopic guidance during surgery

Smart glasses provide fluoroscopic guidance during surgery

Two surgeon tested a device that, when attached to everyday eyeglasses, can display fluoroscopic images used for surgical guidance directly to the surgeon.

AI models could predict outcomes in trauma

AI models could predict outcomes in trauma

AI has shown early success in improving survival and outcomes in traffic accident victims transported by ambulance and in predicting survival after liver transplantation.

Alexa is used for smart hospital room pilot

Alexa is used for smart hospital room pilot

Cedars-Sinai is allowing patients to use an Alexa-powered platform known as Aiva to interact hands-free with nurses and control their entertainment.

Are smart knee implants the future of joint replacements?

Are smart knee implants the future of joint replacements?

Researchers decided it was time to create smarter knee implants that could monitor changes in activity as they happened.

RFID: Tiny digital ‘tags’ improve eye care

RFID: Tiny digital ‘tags’ improve eye care

Radio-frequency identification (or RFID), the popular type of data collection, is helping Kellogg providers make visits more meaningful for patients and reduce wait times.

From TechGiants to HealthTechGiants?

From TechGiants to HealthTechGiants?

Alphabet, Amazon, Apple and Microsoft are all building technologies that have the potential to transform the delivery of care. Here are some examples of BigTech's road into healthcare.

OR without surgeon: science fiction or realistic scenario?

OR without surgeon: science fiction or realistic scenario?

Dr Jan Stallkamp, Professor for Automation in Healthcare and Biotechnology, has a vision: robots that can treat patients more efficiently and more precisely than any human physician.

Surgical robots could make radical prostatectomy safer

Surgical robots could make radical prostatectomy safer

Researchers have developed a minuscule robot that could revolutionize surgical procedures for treating prostate cancer.

Popular articles