UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

Evaluation of machine learning-based classification of clinical impairment and prediction of clinical worsening in multiple sclerosis

Noteboom, Samantha; Seiler, Moritz; Chien, Claudia; Rane, Roshan P; Barkhof, Frederik; Strijbis, Eva MM; Paul, Friedemann; ... Ritter, Kerstin; + view all (2024) Evaluation of machine learning-based classification of clinical impairment and prediction of clinical worsening in multiple sclerosis. Journal of Neurology 10.1007/s00415-024-12507-w. (In press). Green open access

[thumbnail of Barkhof_s00415-024-12507-w.pdf]
Preview
Text
Barkhof_s00415-024-12507-w.pdf

Download (2MB) | Preview

Abstract

Background: Robust predictive models of clinical impairment and worsening in multiple sclerosis (MS) are needed to identify patients at risk and optimize treatment strategies. // Objective: To evaluate whether machine learning (ML) methods can classify clinical impairment and predict worsening in people with MS (pwMS) and, if so, which combination of clinical and magnetic resonance imaging (MRI) features and ML algorithm is optimal. // Methods: We used baseline clinical and structural MRI data from two MS cohorts (Berlin: n = 125, Amsterdam: n = 330) to evaluate the capability of five ML models in classifying clinical impairment at baseline and predicting future clinical worsening over a follow-up of 2 and 5 years. Clinical worsening was defined by increases in the Expanded Disability Status Scale (EDSS), Timed 25-Foot Walk Test (T25FW), 9-Hole Peg Test (9HPT), or Symbol Digit Modalities Test (SDMT). Different combinations of clinical and volumetric MRI measures were systematically assessed in predicting clinical outcomes. ML models were evaluated using Monte Carlo cross-validation, area under the curve (AUC), and permutation testing to assess significance. // Results: The ML models significantly determined clinical impairment at baseline for the Amsterdam cohort, but did not reach significance for predicting clinical worsening over a follow-up of 2 and 5 years. High disability (EDSS ≥ 4) was best determined by a support vector machine (SVM) classifier using clinical and global MRI volumes (AUC = 0.83 ± 0.07, p = 0.015). Impaired cognition (SDMT Z-score ≤ −1.5) was best determined by a SVM using regional MRI volumes (thalamus, ventricles, lesions, and hippocampus), reaching an AUC of 0.73 ± 0.04 (p = 0.008). // Conclusion: ML models could aid in classifying pwMS with clinical impairment and identify relevant biomarkers, but prediction of clinical worsening is an unmet need.

Type: Article
Title: Evaluation of machine learning-based classification of clinical impairment and prediction of clinical worsening in multiple sclerosis
Location: Germany
Open access status: An open access version is available from UCL Discovery
DOI: 10.1007/s00415-024-12507-w
Publisher version: http://dx.doi.org/10.1007/s00415-024-12507-w
Language: English
Additional information: This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Keywords: Multiple sclerosis; Machine learning; Magnetic resonance imaging (MRI); Disability prediction; Cognition
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Brain Repair and Rehabilitation
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10194190
Downloads since deposit
304Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item