title: Robustifying AdaBoost by adding the naive error rate.
abstract: AdaBoost can be derived by sequential minimization of the exponential loss function. It implements the learning process by exponentially reweighting examples according to classification results. However, weights are often too sharply tuned, so that AdaBoost suffers from the nonrobustness and overlearning. Wepropose a new boosting method that is a slight modification of AdaBoost. The loss function is defined by a mixture of the exponential loss and naive error loss functions. As a result, the proposed method incorporates the effect of forgetfulness into AdaBoost. The statistical significance of our method is discussed, and simulations are presented for confirmation.
authors.affiliation: Department of Statistical Science, Graduate University of Advanced Studies, Tokyo, Japan.
authors.forename: Takashi
authors.initials: T
authors.lastname: Takenouchi
authors.forename: Shinto
authors.initials: S
authors.lastname: Eguchi
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D001943:Breast Neoplasms / Q000453:epidemiology; D003198:Computer Simulation; D019992:Databases as Topic; D005260:Female; D006801:Humans; D008962:Models, Theoretical; D016571:Neural Networks, Computer; D015203:Reproducibility of Results