title: On the importance of well-calibrated scores for identifying shotgun proteomics spectra.
abstract: Identifying the peptide responsible for generating an observed fragmentation spectrum requires scoring a collection of candidate peptides and then identifying the peptide that achieves the highest score. However, analysis of a large collection of such spectra requires that the score assigned to one spectrum be well-calibrated with respect to the scores assigned to other spectra. In this work, we define the notion of calibration in the context of shotgun proteomics spectrum identification, and we introduce a simple, albeit computationally intensive, technique to calibrate an arbitrary score function. We demonstrate that this calibration procedure yields an increased number of identified spectra at a fixed false discovery rate (FDR) threshold. We also show that proper calibration of scores has a surprising effect on a previously described FDR estimation procedure, making the procedure less conservative. Finally, we provide empirical results suggesting that even partial calibration, which is much less computationally demanding, can yield significant increases in spectrum identification. Overall, we argue that accurate shotgun proteomics analysis requires careful attention to score calibration.
authors.affiliation: School of Mathematics and Statistics F07, University of Sydney , NSW 2006, Australia.
authors.forename: Uri
authors.initials: U
authors.lastname: Keich
authors.forename: William Stafford
authors.initials: WS
authors.lastname: Noble
mesh_terms: D002138:Calibration; D040901:Proteomics; D029701:Saccharomyces cerevisiae Proteins / Q000737:chemistry
chemical_list: D029701:Saccharomyces cerevisiae Proteins
keywords: Spectrum identification; false discovery rate; score calibration