UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

Amortized Bayesian prototype meta-learning: A new probabilistic meta-learning approach to few-shot image classification

Sun, Z; Wu, J; Li, X; Yang, W; Xue, J; (2021) Amortized Bayesian prototype meta-learning: A new probabilistic meta-learning approach to few-shot image classification. In: Proceedings of the 24th International Conference on Artificial Intelligence and Statistics (AISTATS) 2021. (pp. pp. 1414-1421). PMLR: Volume 130: San Diego, California, USA. Green open access

[thumbnail of ZhuoSun-AISTATS2021-UCL.pdf]
Preview
Text
ZhuoSun-AISTATS2021-UCL.pdf - Accepted Version

Download (2MB) | Preview

Abstract

Probabilistic meta-learning methods recently have achieved impressive success in few-shot image classification. However, they introduce a huge number of random variables for neural network weights and thus severe computational and inferential challenges. In this paper, we propose a novel probabilistic meta-learning method called amortized Bayesian prototype meta-learning. In contrast to previous methods, we introduce only a small number of random variables for latent class prototypes rather than a huge number for network weights; we learn to learn the posterior distributions of these latent prototypes in an amortized inference way with no need for an extra amortization network, such that we can easily approximate their posteriors conditional on few labeled samples, whenever at meta-training or meta-testing stage. The proposed method can be trained end-to-end without any pre-training. Compared with other probabilistic meta-learning methods, our proposed approach is more interpretable with much less random variables, while still be able to achieve competitive performance for few-shot image classification problems on various benchmark datasets. Its excellent robustness and predictive uncertainty are also demonstrated through ablation studies.

Type: Proceedings paper
Title: Amortized Bayesian prototype meta-learning: A new probabilistic meta-learning approach to few-shot image classification
Event: The 24th International Conference on Artificial Intelligence and Statistics
Dates: 13 April 2021 - 15 April 2021
Open access status: An open access version is available from UCL Discovery
Publisher version: http://proceedings.mlr.press/v130/sun21a.html
Language: English
Additional information: This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10122330
Downloads since deposit
5,244Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item