title: Critical assessment of alignment procedures for LC-MS proteomics and metabolomics measurements.
abstract: BACKGROUND
  Liquid chromatography coupled to mass spectrometry (LC-MS) has become a prominent tool for the analysis of complex proteomics and metabolomics samples. In many applications multiple LC-MS measurements need to be compared, e. g. to improve reliability or to combine results from different samples in a statistical comparative analysis. As in all physical experiments, LC-MS data are affected by uncertainties, and variability of retention time is encountered in all data sets. It is therefore necessary to estimate and correct the underlying distortions of the retention time axis to search for corresponding compounds in different samples. To this end, a variety of so-called LC-MS map alignment algorithms have been developed during the last four years. Most of these approaches are well documented, but they are usually evaluated on very specific samples only. So far, no publication has been assessing different alignment algorithms using a standard LC-MS sample along with commonly used quality criteria.
  
  
  RESULTS
  We propose two LC-MS proteomics as well as two LC-MS metabolomics data sets that represent typical alignment scenarios. Furthermore, we introduce a new quality measure for the evaluation of LC-MS alignment algorithms. Using the four data sets to compare six freely available alignment algorithms proposed for the alignment of metabolomics and proteomics LC-MS measurements, we found significant differences with respect to alignment quality, running time, and usability in general.
  
  
  CONCLUSIONS
  The multitude of available alignment methods necessitates the generation of standard data sets and quality measures that allow users as well as developers to benchmark and compare their map alignment tools on a fair basis. Our study represents a first step in this direction. Currently, the installation and evaluation of the "correct" parameter settings can be quite a time-consuming task, and the success of a particular method is still highly dependent on the experience of the user. Therefore, we propose to continue and extend this type of study to a community-wide competition. All data as well as our evaluation scripts are available at http://msbi.ipb-halle.de/msbi/caap.
authors.affiliation: Beatson Institute for Cancer Research, Proteomics and Mass Spectrometry Group, Scotland, UK. e.lange@beatson.gla.ac.uk
authors.forename: Eva
authors.initials: E
authors.lastname: Lange
authors.forename: Ralf
authors.initials: R
authors.lastname: Tautenhahn
authors.forename: Steffen
authors.initials: S
authors.lastname: Neumann
authors.forename: Clemens
authors.initials: C
authors.lastname: Gröpl
mesh_terms: D000465:Algorithms; D000595:Amino Acid Sequence; D002853:Chromatography, Liquid / Q000379:methods*; D013058:Mass Spectrometry / Q000379:methods*; D008969:Molecular Sequence Data; D010449:Peptide Mapping / Q000379:methods*; D020543:Proteome / Q000737:chemistry* / Q000378:metabolism*; D016415:Sequence Alignment / Q000379:methods*; D020539:Sequence Analysis, Protein / Q000379:methods*
chemical_list: D020543:Proteome
references.citation: Plant Physiol. 2008 Aug;147(4):2107-20
references.pmid: 18552234
references.citation: Anal Chem. 2006 Feb 1;78(3):779-87
references.pmid: 16448051
references.citation: Phys Biol. 2008 Feb 20;5(1):011001
references.pmid: 18367780
references.citation: Biostatistics. 2007 Apr;8(2):357-67
references.pmid: 16880200
references.citation: Genome Biol. 2004;5(10):R80
references.pmid: 15461798
references.citation: Mol Cell Proteomics. 2006 Sep;5(9):1543-58
references.pmid: 16804162
references.citation: Bioinformatics. 2007 Jul 1;23(13):i273-81
references.pmid: 17646306
references.citation: Mol Cell Proteomics. 2007 Oct;6(10):1711-26
references.pmid: 17586839
references.citation: Anal Chem. 2006 Nov 1;78(21):7397-409
references.pmid: 17073405
references.citation: Bioinformatics. 2006 Aug 1;22(15):1902-9
references.pmid: 16766559
references.citation: Bioinformatics. 2007 Jan 15;23(2):e198-204
references.pmid: 17237092
references.citation: Bioinformatics. 2006 Apr 1;22(7):789-94
references.pmid: 16410320
references.citation: Proteins. 2007;69 Suppl 8:3-9
references.pmid: 17918729
references.citation: Proteomics. 2008 Feb;8(4):731-49
references.pmid: 18297651
references.citation: Methods. 2003 Feb;29(2):124-30
references.pmid: 12606218
references.citation: Mol Cell Proteomics. 2006 Mar;5(3):423-32
references.pmid: 16269421
references.citation: J Chromatogr A. 2002 Jul 5;961(2):237-44
references.pmid: 12184621
references.citation: Expert Rev Proteomics. 2006 Apr;3(2):165-8
references.pmid: 16608429
references.citation: BMC Bioinformatics. 2008 Mar 26;9:163
references.pmid: 18366760
references.citation: Mol Cell Proteomics. 2004 Oct;3(10):984-97
references.pmid: 15269249
references.citation: Nat Biotechnol. 2004 Apr;22(4):471-2
references.pmid: 15085804
references.citation: Mol Cell Proteomics. 2005 Sep;4(9):1328-40
references.pmid: 16048906
references.citation: Genome Res. 2005 Aug;15(8):1118-26
references.pmid: 16077011
references.citation: Bioinformatics. 2005 Nov 1;21(21):4054-9
references.pmid: 16150809
references.citation: Proc Natl Acad Sci U S A. 2005 Oct 4;102(40):14458-62
references.pmid: 16186495
references.citation: BMC Bioinformatics. 2005 Jul 18;6:179
references.pmid: 16026613
references.citation: Proteomics. 2008 Feb;8(4):650-72
references.pmid: 18297649
references.citation: PLoS Comput Biol. 2007 Jul;3(7):e114
references.pmid: 17676979
references.citation: Bioinformatics. 2007 Jan 15;23(2):e191-7
references.pmid: 17237091
references.citation: Mol Cell Proteomics. 2007 May;6(5):755-66
references.pmid: 17293593
references.citation: Nat Chem Biol. 2005 Oct;1(5):252-62
references.pmid: 16408053
references.citation: Mol Cell Proteomics. 2005 Apr;4(4):419-34
references.pmid: 15741312
references.citation: Bioinformatics. 2006 Mar 1;22(5):634-6
references.pmid: 16403790
references.citation: Anal Chem. 2006 Sep 1;78(17):6140-52
references.pmid: 16944896