Li, X;
Chang, D;
Ma, Z;
Tan, Z-H;
Xue, J;
Cao, J;
Guo, J;
(2021)
Deep InterBoost networks for small-sample image classification.
Neurocomputing
, 456
pp. 492-503.
10.1016/j.neucom.2020.06.135.
Preview |
Text
NEUCOM-D-20-00602R1-accepted.pdf - Accepted Version Download (9MB) | Preview |
Abstract
Deep neural networks have recently shown excellent performance on numerous image classification tasks. These networks often need to estimate a large number of parameters and require much training data. When the amount of training data is small, however, a network with high flexibility quickly overfits the training data, resulting in a large model variance and poor generalization. To address this problem, we propose a new, simple yet effective ensemble method called InterBoost for small-sample image classification. In the training phase, InterBoost first randomly generates two sets of complementary weights for training data, which are used for separately training two base networks of the same structure, and then the two sets of complementary weights are updated for refining the training of the networks through interaction between the two base networks previously trained. This interactive training process continues iteratively until a stop criterion is met. In the testing phase, the outputs of the two networks are combined to obtain one final score for classification. Experimental results on four small-sample datasets, UIUC-Sports, LabelMe, 15Scenes and Caltech101, demonstrate that the proposed ensemble method outperforms existing ones. Moreover, results from the Wilcoxon signed-rank tests show that our method is statistically significantly better than the methods compared. Detailed analysis is also provided for an in-depth understanding of the proposed method.
Type: | Article |
---|---|
Title: | Deep InterBoost networks for small-sample image classification |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1016/j.neucom.2020.06.135 |
Publisher version: | https://doi.org/10.1016/j.neucom.2020.06.135 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | Ensemble learning, Deep neural network, Small-sample image classification, Overfitting |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10106585 |
Archive Staff Only
View Item |