In the future, surgeons in training can virtually practice one of the most...
In the future, surgeons in training can virtually practice one of the most complicated steps in hip replacement surgery.
Source: Project "HIPS"

VR and lightweight robot simulate hip replacement

In Germany, more than 200,000 patients undergo hip replacement surgery each year. In order to avoid complications and to extend the life span of the artificial joint the implants have to fitted precisely in the hip socket, the acetabulum. The procedure, particularly milling the acetabulum, is not only difficult, it is also difficult to teach and train. This is where HIPS comes in, the “HüftImplantatPfannenfräsSimulator”, developed by a research consortium. “HIPS is the worldwide first Virtual Reality training simulator for hip replacement surgery that provides haptic feedback and can simulate interventions that require high and stable forces,” explains Mario Lorenz of the Technical University of Chemnitz, who initiated the cooperation project.

Prime goal of the researchers was to improve specialist physician training, as Lorenz underlines: “Today, specialist physicians in training practice on phantoms, i.e. artificial bones. Material behaviour, however, does not mirror real material behaviour closely enough, which in fact also holds true for donor bone material – a rare and extremely valuable resource in medical training and research.”

Specialist physicians in training have to assist in a number of surgeries before they are asked to perform the milling step themselves. “Wouldn’t it be much better if the physicians in training had performed several simulations that are as close as possible to the real thing before that crucial moment arrives? Wouldn’t it be better to give them an opportunity to develop the necessary feel for the procedure, build self-confidence and allow them to make errors from which they can learn?“, Lorenz asks. In minimally invasive surgery such as keyhole interventions, VR training has been around for about 20 years, Lorenz points out and adds that “For procedures that require high forces such simulation products are not available, neither commercially nor for research purposes.”

The HIPS users see the virtual patient’s hips through VR glasses while they operate a surgical milling instrument which in turn is connected to a lightweight robot, the BR iiwa. The user has to mill the hip joint’s acetabulum – something that is difficult to teach, train and learn. The robot delivers direct haptic feedback by simulating the resistance of a real bone. Thus the user acquires a better feel for the forces at work and the area that can be worked.

Research

The simulation is based on real data. In order to compute the forces and torques when milling the hip the researchers conducted biomechanical tests with anatomical specimens. “We found out that we are dealing with up to 200 Newton. The force is needed when the surgeon applies pressure on the acetabulum. The forces applied on the surgeon’s wrists when the machine stops is between 20 and 50 Newton depending on the size of the wrist,” Lorenz reports.

With these measurement data researchers at the University of Bremen, Germany, designed a material model which allows the surgeon to compute within a millisecond where the surgical milling instrument meets the acetabulum and which forces are present.

In a next step a software module was developed which features a user interface integrated by FAKT Software GmbH. The result is an interactive application based on an anatomical model by CAT Production GmbH which had created the anatomical 3D models and the virtual OR.

The team at the Technical University Chemnitz developed the interface with the robot arm to “tell” the robot the force it has to simulate. “Originally, the robot was certified for collaborative human-machine tasks on the shop floor. We managed to use the existing interface to provide the user with haptic feedback while maintaining the certification,” Lorenz explains.

Virtually practising hip surgery with the...
Virtually practising hip surgery with the “HüftImplantatPfannenfräsSimulator” (HIPS).
Source: TU Chemnitz/Rene Apitzsch

Dynamic HIPS - The next steps

Scientists are developing a dynamic hip implant simulator in the "Dynamic HIPS" project, which officially started on 1 May 2020.

The project pursues several goals that will make it possible to develop the necessary training devices. The researchers want to determine the forces, torques and speeds that occur during the three surgical steps to be simulated. On this basis, they want to further develop a robotic arm and existing haptic devices – devices that can convey realistic sensory perceptions. Equally important is the creation of a mathematical model that simulates the resistances and material removal at the bone. This information must be transmitted to the robot within a millisecond to give the surgeons a realistic feeling.

A second set of objectives deals with VR technology, which enables joint training over long distances ("remote training"). With the help of a multi-user system, experienced surgeons can pass on their medical expertise to trainee surgeons without being on-site themselves. This functionality not only facilitates the transfer of knowledge to emerging and developing countries but also serves the exchange of knowledge between experienced surgeons.

Researchers face the challenge of minimizing the time delays in synchronizing VR scenes despite the large spatial distance between users so that both surgeons are in an identical situation. At the same time, the scientists want to strengthen the interaction between users in the VR environment by providing ways to communicate without words, for example by pointing to virtual 3D drawings. In the future, it should also be possible to record sequences and add audio commentary to create training videos.

Virtual milling on the surgical training simulator.
Virtual milling on the surgical training simulator.
Source: Screenshot “Video report of project meeting”

Profile:
In 2011, after having completed his informatics program at Westsächsische Hochschule Zwickau, Germany, in the previous year, Mario Lorenz was appointed assistant at the Chair of Machine Tools at the Technical University Chemnitz in the field of VR and Augmented Reality (AR). Since 2016, he has also been guest scientist at the Clinic for Orthopaedics, Trauma und Plastic Surgery at University Hospital Leipzig. His research focuses on the use of VR and AR technologies in production and medical training.


You are a professional from the emtech ecosystem and interested in sharing your tech tale with a guest contribution at Tectales? Just contact us: editorial@tectales.com.

Subscribe to our newsletter

Related articles

The role of surgical 3D printing in hospitals

The role of surgical 3D printing in hospitals

More and more hospitals are entering the world of 3D printing in surgery as decision-makers and surgeons are realising the immense benefits for surgeons and patients alike.

Humanising wearable health technologies

Humanising wearable health technologies

Designer Leah Heiss considers her work as creating “emotional technologies”, i.e. wearable devices based on human-centred design principles. For her, empathy is everything!

9 disinfection robots fighting the coronavirus

9 disinfection robots fighting the coronavirus

Surfaces contaminated with SARS-CoV-2 pose a grave threat to the safety of staff and patients. To minimize the risks for their staff, hospitals are utilizing disinfection robots to sanitize surfaces.

Digital transformation: From sick care to proactive health care

Digital transformation: From sick care to proactive health care

“The digital transformation will make healthcare even more human. It will enable us to provide preventive and personalized healthcare!”


NVIDIA Healthcare 2.0 – Developing and deploying AI in healthcare

NVIDIA Healthcare 2.0 – Developing and deploying AI in healthcare

“AI is the biggest technological breakthrough of our lifetime. It will boost the entire healthcare ecosystem and will eventually re-invent the way we deliver medicine entirely.”

AI in healthcare – hype, hope and reality

AI in healthcare – hype, hope and reality

Currently, we are too focused on the topic of AI. In order, however, to leverage AI technology several challenges have to be mastered and a proper framework has to be established.

ELSAH – A ‘Smart Patch’ to determine biomarkers

ELSAH – A ‘Smart Patch’ to determine biomarkers

At the start of 2019 the EU project ELSAH began with the objective of designing a wearable within four years that enables the continuous determination of biomarker concentrations.

From TechGiants to HealthTechGiants?

From TechGiants to HealthTechGiants?

Alphabet, Amazon, Apple and Microsoft are all building technologies that have the potential to transform the delivery of care. Here are some examples of BigTech's road into healthcare.

Augmented Reality in the OR: matching man and machine

Augmented Reality in the OR: matching man and machine

One of the crucial future technologies in surgery is Augmented Reality. Most experts agree that AR will increase safety and efficiency, improve surgical training and decrease costs.

Popular articles