UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

Privileged anatomical and protocol discrimination in trackerless 3D ultrasound reconstruction

Li, Qi; Shen, Ziyi; Li, Qian; Barratt, Dean C; Dowrick, Thomas; Clarkson, Matthew J; Vercauteren, Tom; (2023) Privileged anatomical and protocol discrimination in trackerless 3D ultrasound reconstruction. In: International Workshop on Advances in Simplifying Medical Ultrasound ASMUS 2023: Simplifying Medical Ultrasound. (pp. pp. 142-151). Springer: Cham, Switzerland. Green open access

[thumbnail of Privileged Anatomical and Protocol Discrimination in Trackerless 3D Ultrasound Reconstruction.pdf]
Preview
Text
Privileged Anatomical and Protocol Discrimination in Trackerless 3D Ultrasound Reconstruction.pdf - Accepted Version

Download (4MB) | Preview

Abstract

Three-dimensional (3D) freehand ultrasound (US) reconstruction without using any additional external tracking device has seen recent advances with deep neural networks (DNNs). In this paper, we first investigated two identified contributing factors of the learned inter-frame correlation that enable the DNN-based reconstruction: anatomy and protocol. We propose to incorporate the ability to represent these two factors - readily available during training - as the privileged information to improve existing DNN-based methods. This is implemented in a new multi-task method, where the anatomical and protocol discrimination are used as auxiliary tasks. We further develop a differentiable network architecture to optimise the branching location of these auxiliary tasks, which controls the ratio between shared and task-specific network parameters, for maximising the benefits from the two auxiliary tasks. Experimental results, on a dataset with 38 forearms of 19 volunteers acquired with 6 different scanning protocols, show that 1) both anatomical and protocol variances are enabling factors for DNN-based US reconstruction; 2) learning how to discriminate different subjects (anatomical variance) and predefined types of scanning paths (protocol variance) both significantly improve frame prediction accuracy, volume reconstruction overlap, accumulated tracking error and final drift, using the proposed algorithm.

Type: Proceedings paper
Title: Privileged anatomical and protocol discrimination in trackerless 3D ultrasound reconstruction
Event: Advances in Simplifying Medical UltraSound (ASMUS) workshop at MICCAI 2023
Location: Vancouver, Canada
Dates: 8 Oct 2023 - 12 Oct 2023
Open access status: An open access version is available from UCL Discovery
DOI: 10.1007/978-3-031-44521-7_14
Publisher version: https://doi.org/10.1007/978-3-031-44521-7_14
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Freehand ultrasound, Privileged information, Multi-task learning
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Med Phys and Biomedical Eng
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10178259
Downloads since deposit
210Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item