VisionBlender generates computer vision datasets for robotic surgery

Researchers at the Hamlyn Centre, Imperial College London, have won the outstanding paper award at the MICCAI workshop by introducing a novel tool for generating accurate endoscopic datasets.

Photo

Surgical robots rely on robust and efficient computer vision algorithms to be able to intervene in real-time. With clear and accurate datasets, surgeons are able to precisely move surgical tools in reference to the deforming soft tissue.

However, the main issue is that training or testing of such algorithms, especially when using deep learning techniques, requires large endoscopic datasets. Obtaining these large datasets can be seen as a challenge task as it requires expensive hardwares, ethical approvals, patient consent and the access to hospitals.

VisionBlender is a synthetic dataset generator and is specifically built for assisting robotic surgery. By adding a user interface to Blender, this tool allows users to generate realistic video sequences with ground truth maps of depth, disparity, segmentation masks, surface normals, optical flow, object pose, and camera parameters.

VisionBlender generates computer vision datasets for robotic surgery

In the presentation at the workshop of Medical Image Computing and Computer Assisted Intervention 2020 (MICCAI 2020), our researchers not only presented the example of endoscopic data that can be generated by using this tool, but also demonstrated one of potential applications where the generated data has been used to train and evaluate state-of-the-art 3D reconstruction algorithms.

Being able to generate realistic endoscopic datasets efficiently, VisionBlender promises an exciting step forward in robotic surgery.

VisionBlender is an open source project. More information can be found on VisionBlender's GitHub page.

Subscribe to our newsletter

Related articles

Surgery robots set to learn how to better assist

Surgery robots set to learn how to better assist

The objective of the AIMRobot project is to pave the way for the next generation of robotic surgery systems capable of autonomy.

Augmented intelligence advances robotic surgery

Augmented intelligence advances robotic surgery

TransEnterix, Inc. announced that a hospital in New Jersey successfully completed its first surgical procedures using the Intelligent Surgical UnitTM.

Soft robots, origami combine to deliver treatments

Soft robots, origami combine to deliver treatments

Researchers have found a way to send tiny, soft robots into humans, potentially opening the door for less invasive surgeries and ways to deliver treatments for several conditions.

Endoscopic robotic system used for treating cancer

Endoscopic robotic system used for treating cancer

Researchers have developed an robotic system to enhance the safety and efficacy of endoscopic submucosal dissection (ESD) for the treatment of gastrointestinal cancer.

Smart surgery - from technical fascination to clinical reality

Smart surgery - from technical fascination to clinical reality

Artificial intelligence is developing at an enormous speed and intelligent instruments will profoundly change surgery and medical interventions.

Origami-inspired miniature manipulator for microsurgery

Origami-inspired miniature manipulator for microsurgery

Researchers have developed a surgical robot that improves precision and control of teleoperated surgical procedures.

Mouth and throat cancer: Robotic surgery may improve outcomes

Mouth and throat cancer: Robotic surgery may improve outcomes

Robotic surgery for patients with early stage, oropharyngeal squamous cell cancer is associated with improved health outcomes, including better long-term survival.

AI system for recognition of hand gestures

AI system for recognition of hand gestures

Scientists have developed an AI system that recognises hand gestures by combining skin-like electronics with computer vision.

avateramedical acquires robotics specialist FORWARDttc

avateramedical acquires robotics specialist FORWARDttc

avateramedical GmbH announced the acquisition of FORWARDttc GmbH, an automation technology company with special focus on robotics hard- and software.

Popular articles