Xu, Y; Yan, Y; Xue, J-H; Lu, Y; Wang, H; (2021) Small-Vote Sample Selection for Label-Noise Learning. In: Machine Learning and Knowledge Discovery in Databases. Research Track. (pp. pp. 729-744). Springer International Publishing: Cham, Switzerland.

Preview

Text YouzeXu-ECMLPKDD2021-accepted.pdf - Accepted Version Download (1MB) | Preview

Abstract

The small-loss criterion is widely used in recent label-noise learning methods. However, such a criterion only considers the loss of each training sample in a mini-batch but ignores the loss distribution in the whole training set. Moreover, the selection of clean samples depends on a heuristic clean data rate. As a result, some noisy-labeled samples are easily identified as clean ones, and vice versa. In this paper, we propose a novel yet simple sample selection method, which mainly consists of a Hierarchical Voting Scheme (HVS) and an Adaptive Clean data rate Estimation Strategy (ACES), to accurately identify clean samples and noisy-labeled samples for robust learning. Specifically, we propose HVS to effectively combine the global vote and the local vote, so that both epoch-level and batch-level information is exploited to assign a hierarchical vote for each mini-batch sample. Based on HVS, we further develop ACES to adaptively estimate the clean data rate by leveraging a 1D Gaussian Mixture Model (GMM). Experimental results show that our proposed method consistently outperforms several state-of-the-art label-noise learning methods on both synthetic and real-world noisy benchmark datasets.

Download activity - last month

Export as XMLJSONCSV

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as JSONXMLCSV

Archive Staff Only

View Item