Sun, Z;
Wu, J;
Li, X;
Yang, W;
Xue, J;
(2021)
Amortized Bayesian prototype meta-learning: A new probabilistic meta-learning approach to few-shot image classification.
In:
Proceedings of the 24th International Conference on Artificial Intelligence and Statistics (AISTATS) 2021.
(pp. pp. 1414-1421).
PMLR: Volume 130: San Diego, California, USA.
Preview |
Text
ZhuoSun-AISTATS2021-UCL.pdf - Accepted Version Download (2MB) | Preview |
Abstract
Probabilistic meta-learning methods recently have achieved impressive success in few-shot image classification. However, they introduce a huge number of random variables for neural network weights and thus severe computational and inferential challenges. In this paper, we propose a novel probabilistic meta-learning method called amortized Bayesian prototype meta-learning. In contrast to previous methods, we introduce only a small number of random variables for latent class prototypes rather than a huge number for network weights; we learn to learn the posterior distributions of these latent prototypes in an amortized inference way with no need for an extra amortization network, such that we can easily approximate their posteriors conditional on few labeled samples, whenever at meta-training or meta-testing stage. The proposed method can be trained end-to-end without any pre-training. Compared with other probabilistic meta-learning methods, our proposed approach is more interpretable with much less random variables, while still be able to achieve competitive performance for few-shot image classification problems on various benchmark datasets. Its excellent robustness and predictive uncertainty are also demonstrated through ablation studies.
Type: | Proceedings paper |
---|---|
Title: | Amortized Bayesian prototype meta-learning: A new probabilistic meta-learning approach to few-shot image classification |
Event: | The 24th International Conference on Artificial Intelligence and Statistics |
Dates: | 13 April 2021 - 15 April 2021 |
Open access status: | An open access version is available from UCL Discovery |
Publisher version: | http://proceedings.mlr.press/v130/sun21a.html |
Language: | English |
Additional information: | This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions. |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10122330 |
Archive Staff Only
View Item |