title: Performance generalization in biometric authentication using joint user-specific and sample bootstraps.
abstract: Biometric authentication performance is often depicted by a detection error trade-off (DET) curve. We show that this curve is dependent on the choice of samples available, the demographic composition and the number of users specific to a database. We propose a two-step bootstrap procedure to take into account the three mentioned sources of variability. This is an extension to the Bolle et al.'s bootstrap subset technique. Preliminary experiments on the NIST2005 and XM2VTS benchmark databases are encouraging, e.g., the average result across all 24 systems evaluated on NIST2005 indicates that one can predict, with more than 75 percent of DET coverage, an unseen DET curve with eight times more users. Furthermore, our finding suggests that with more data available, the confidence intervals become smaller and, hence, more useful.
authors.affiliation: IDIAP Research Institute, Martigny, Switzerland. norman@idiap.ch
authors.forename: Norman
authors.initials: N
authors.lastname: Poh
authors.forename: Alvin
authors.initials: A
authors.lastname: Martin
authors.forename: Samy
authors.initials: S
authors.lastname: Bengio
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D001699:Biometry / Q000379:methods*; D003198:Computer Simulation; D005145:Face / Q000033:anatomy & histology*; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D015233:Models, Statistical; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D049250:Speech Recognition Software