Fifty participants were recruited from four stages of neurosurgical training; neurosurgeons, fellows and senior residents, junior residents, and medical students. They performed 250 complex tumour resections using NeuroVR, a virtual reality surgical simulator developed by the National Research Council of Canada and distributed by CAE, which recorded all instrument movements in 20 millisecond intervals.
Using this raw data, a machine learning algorithm developed performance measures such as instrument position and force applied, as well as outcomes such as amount of tumour removed and blood loss, which could predict the level of expertise of each participant with 90 per-cent accuracy. The top performing algorithm could classify participants using just six performance measures.
This research shows that the fusion of AI and VR neurosurgical simulators can accurately and efficiently assess the performance of surgeon trainees. This means that AI-assisted mentoring systems can be developed that focus on improving patient safety by guiding trainees through complex surgical procedures. These systems can determine areas that need improvement and how the trainee can develop these important skills before surgeons operate on real patients.
“Physician educators are facing increased time pressure to balance their commitment to both patients and learners,” says Dr. Rolando Del Maestro, the lead author of the study. “Our study proves that we can design systems that deliver on-demand surgical assessments at the convenience of the learner and with less input from instructors. It may also lead to better patient safety by reducing the chance for human error both while assessing surgeons and in the operating room.”