Khanal, Bidur;
Bhattarai, Binod;
Khanal, Bishesh;
Stoyanov, Danail;
Linte, Cristian A;
(2023)
M-VAAL: Multimodal Variational Adversarial Active Learning for Downstream Medical Image Analysis Tasks.
In: Waiter, G and Lambrou, T and Leontidis, G and Oren, N and Morris, T and Gordon, S, (eds.)
Medical Image Understanding and Analysis: 27th Annual Conference, MIUA 2023, Aberdeen, UK, July 19–21, 2023, Proceedings.
(pp. pp. 48-63).
Springer: Cham, Switzerland.
Preview |
Text
MVAAL_MIUA_2023.pdf - Accepted Version Download (1MB) | Preview |
Abstract
Acquiring properly annotated data is expensive in the medical field as it requires experts, time-consuming protocols, and rigorous validation. Active learning attempts to minimize the need for large annotated samples by actively sampling the most informative examples for annotation. These examples contribute significantly to improving the performance of supervised machine learning models, and thus, active learning can play an essential role in selecting the most appropriate information in deep learning-based diagnosis, clinical assessments, and treatment planning. Although some existing works have proposed methods for sampling the best examples for annotation in medical image analysis, they are not task-agnostic and do not use multimodal auxiliary information in the sampler, which has the potential to increase robustness. Therefore, in this work, we propose a Multimodal Variational Adversarial Active Learning (M-VAAL) method that uses auxiliary information from additional modalities to enhance the active sampling. We applied our method to two datasets: i) brain tumor segmentation and multi-label classification using the BraTS2018 dataset, and ii) chest Xray image classification using the COVID-QU-Ex dataset. Our results show a promising direction toward data-efficient learning under limited annotations.
| Type: | Proceedings paper |
|---|---|
| Title: | M-VAAL: Multimodal Variational Adversarial Active Learning for Downstream Medical Image Analysis Tasks |
| Event: | 27th Annual Conference on Medical Image Understanding and Analysis (MIUA) |
| Location: | SCOTLAND, Univ Aberdeen, Aberdeen |
| Dates: | 19 Jul 2023 - 21 Jul 2023 |
| ISBN-13: | 978-3-031-48592-3 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1007/978-3-031-48593-0_4 |
| Publisher version: | https://doi.org/10.1007/978-3-031-48593-0_4 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10190461 |
Archive Staff Only
 |
View Item |
