UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

Artificial Intelligence Assisted Surgical Scene Recognition. A Comparative Study Amongst Healthcare Professionals

Williams, Simon C; Zhou, Jinfan; Muirhead, William R; Khan, Danyal Z; Koh, Chan Hee; Ahmed, Razna; Funnell, Jonathan P; ... Marcus, Hani J; + view all (2024) Artificial Intelligence Assisted Surgical Scene Recognition. A Comparative Study Amongst Healthcare Professionals. Annals of Surgery 10.1097/sla.0000000000006577. (In press). Green open access

[thumbnail of artificial_intelligence_assisted_surgical_scene.1116.pdf]
Preview
Text
artificial_intelligence_assisted_surgical_scene.1116.pdf - Accepted Version

Download (733kB) | Preview

Abstract

Objective: This study aimed to compare the ability of a deep-learning platform (the MACSSwin-T model) with healthcare professionals in detecting cerebral aneurysms from operative videos. Secondly, we aimed to compare the neurosurgical team’s ability to detect cerebral aneurysms with and without AI-assistance. Background: Modern microscopic surgery enables the capture of operative video data on an unforeseen scale. Advances in computer vision, a branch of artificial intelligence (AI), have enabled automated analysis of operative video. These advances are likely to benefit clinicians, healthcare systems, and patients alike, yet such benefits are yet to be realised. Methods: In a cross-sectional comparative study, neurosurgeons, anaesthetists, and operating room (OR) nurses, all at varying stages of training and experience, reviewed still frames of aneurysm clipping operations and labelled frames as “aneurysm not in frame” or “aneurysm in frame”. Frames then underwent analysis by the AI platform. A second round of data collection was performed whereby the neurosurgical team had AI-assistance. Accuracy of aneurysm detection was calculated for human only, AI only, and AI-assisted human groups. Results: 5,154 individual frame reviews were collated from 338 healthcare professionals. Healthcare professionals correctly labelled 70% of frames without AI assistance, compared to 78% with AI-assistance (OR 1.77, P<0.001). Neurosurgical Attendings showed the greatest improvement, from 77% to 92% correct predictions with AI-assistance (OR 4.24, P=0.003). Conclusion: AI-assisted human performance surpassed both human and AI alone. Notably, across healthcare professionals surveyed, frame accuracy improved across all subspecialties and experience levels, particularly among the most experienced healthcare professionals. These results challenge the prevailing notion that AI primarily benefits junior clinicians, highlighting its crucial role throughout the surgical hierarchy as an essential component of modern surgical practice.

Type: Article
Title: Artificial Intelligence Assisted Surgical Scene Recognition. A Comparative Study Amongst Healthcare Professionals
Open access status: An open access version is available from UCL Discovery
DOI: 10.1097/sla.0000000000006577
Publisher version: http://dx.doi.org/10.1097/sla.0000000000006577
Language: English
Additional information: © 2024 Wolters Kluwer Health, Inc. This is an open access article distributed under the Creative Commons Attribution License 4.0 (http://creativecommons.org/licenses/by/4.0/).
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10199474
Downloads since deposit
182Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item