Leroy, Arthur;
Latouche, Pierre;
Guedj, Benjamin;
Gey, Servane;
(2023)
Cluster-Specific Predictions with Multi-Task Gaussian Processes.
Journal of Machine Learning Research
, 24
(5)
pp. 1-49.
Preview |
PDF
20-1321.pdf - Published Version Download (5MB) | Preview |
Abstract
A model involving Gaussian processes (GPs) is introduced to simultaneously handle multitask learning, clustering, and prediction for multiple functional data. This procedure acts as a model-based clustering method for functional data as well as a learning step for subsequent predictions for new tasks. The model is instantiated as a mixture of multi-task GPs with common mean processes. A variational EM algorithm is derived for dealing with the optimisation of the hyper-parameters along with the hyper-posteriors’ estimation of latent variables and processes. We establish explicit formulas for integrating the mean processes and the latent clustering variables within a predictive distribution, accounting for uncertainty in both aspects. This distribution is defined as a mixture of cluster-specific GP predictions, which enhances the performance when dealing with group-structured data. The model handles irregular grids of observations and offers different hypotheses on the covariance structure for sharing additional information across tasks. The performances on both clustering and prediction tasks are assessed through various simulated scenarios and real data sets. The overall algorithm, called MagmaClust, is publicly available as an R package.
| Type: | Article |
|---|---|
| Title: | Cluster-Specific Predictions with Multi-Task Gaussian Processes |
| Open access status: | An open access version is available from UCL Discovery |
| Publisher version: | https://www.jmlr.org/papers/v24/20-1321.html |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third-party material in this article are included in the Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
| Keywords: | cs.LG, cs.LG, stat.CO, stat.ME, stat.ML |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10176070 |
Archive Staff Only
 |
View Item |
