Critical assessment of alignment procedures for LC-MS proteomics and metabolomics measurements.
BACKGROUND
Liquid chromatography coupled to mass spectrometry (LC-MS) has become a prominent tool for the analysis of complex proteomics and metabolomics samples. In many applications multiple LC-MS measurements need to be compared, e. g. to improve reliability or to combine results from different samples in a statistical comparative analysis. As in all physical experiments, LC-MS data are affected by uncertainties, and variability of retention time is encountered in all data sets. It is therefore necessary to estimate and correct the underlying distortions of the retention time axis to search for corresponding compounds in different samples. To this end, a variety of so-called LC-MS map alignment algorithms have been developed during the last four years. Most of these approaches are well documented, but they are usually evaluated on very specific samples only. So far, no publication has been assessing different alignment algorithms using a standard LC-MS sample along with commonly used quality criteria.


RESULTS
We propose two LC-MS proteomics as well as two LC-MS metabolomics data sets that represent typical alignment scenarios. Furthermore, we introduce a new quality measure for the evaluation of LC-MS alignment algorithms. Using the four data sets to compare six freely available alignment algorithms proposed for the alignment of metabolomics and proteomics LC-MS measurements, we found significant differences with respect to alignment quality, running time, and usability in general.


CONCLUSIONS
The multitude of available alignment methods necessitates the generation of standard data sets and quality measures that allow users as well as developers to benchmark and compare their map alignment tools on a fair basis. Our study represents a first step in this direction. Currently, the installation and evaluation of the "correct" parameter settings can be quite a time-consuming task, and the success of a particular method is still highly dependent on the experience of the user. Therefore, we propose to continue and extend this type of study to a community-wide competition. All data as well as our evaluation scripts are available at http://msbi.ipb-halle.de/msbi/caap.
Lange
Eva
E
Beatson Institute for Cancer Research, Proteomics and Mass Spectrometry Group, Scotland, UK. e.lange@beatson.gla.ac.uk
Tautenhahn
Ralf
R
Neumann
Steffen
S
Gröpl
Clemens
C
D000465:Algorithms; D000595:Amino Acid Sequence; D002853:Chromatography, Liquid / Q000379:methods*; D013058:Mass Spectrometry / Q000379:methods*; D008969:Molecular Sequence Data; D010449:Peptide Mapping / Q000379:methods*; D020543:Proteome / Q000737:chemistry* / Q000378:metabolism*; D016415:Sequence Alignment / Q000379:methods*; D020539:Sequence Analysis, Protein / Q000379:methods*
D020543:Proteome
Plant Physiol. 2008 Aug;147(4):2107-20
18552234
Anal Chem. 2006 Feb 1;78(3):779-87
16448051
Phys Biol. 2008 Feb 20;5(1):011001
18367780
Biostatistics. 2007 Apr;8(2):357-67
16880200
Genome Biol. 2004;5(10):R80
15461798
Mol Cell Proteomics. 2006 Sep;5(9):1543-58
16804162
Bioinformatics. 2007 Jul 1;23(13):i273-81
17646306
Mol Cell Proteomics. 2007 Oct;6(10):1711-26
17586839
Anal Chem. 2006 Nov 1;78(21):7397-409
17073405
Bioinformatics. 2006 Aug 1;22(15):1902-9
16766559
Bioinformatics. 2007 Jan 15;23(2):e198-204
17237092
Bioinformatics. 2006 Apr 1;22(7):789-94
16410320
Proteins. 2007;69 Suppl 8:3-9
17918729
Proteomics. 2008 Feb;8(4):731-49
18297651
Methods. 2003 Feb;29(2):124-30
12606218
Mol Cell Proteomics. 2006 Mar;5(3):423-32
16269421
J Chromatogr A. 2002 Jul 5;961(2):237-44
12184621
Expert Rev Proteomics. 2006 Apr;3(2):165-8
16608429
BMC Bioinformatics. 2008 Mar 26;9:163
18366760
Mol Cell Proteomics. 2004 Oct;3(10):984-97
15269249
Nat Biotechnol. 2004 Apr;22(4):471-2
15085804
Mol Cell Proteomics. 2005 Sep;4(9):1328-40
16048906
Genome Res. 2005 Aug;15(8):1118-26
16077011
Bioinformatics. 2005 Nov 1;21(21):4054-9
16150809
Proc Natl Acad Sci U S A. 2005 Oct 4;102(40):14458-62
16186495
BMC Bioinformatics. 2005 Jul 18;6:179
16026613
Proteomics. 2008 Feb;8(4):650-72
18297649
PLoS Comput Biol. 2007 Jul;3(7):e114
17676979
Bioinformatics. 2007 Jan 15;23(2):e191-7
17237091
Mol Cell Proteomics. 2007 May;6(5):755-66
17293593
Nat Chem Biol. 2005 Oct;1(5):252-62
16408053
Mol Cell Proteomics. 2005 Apr;4(4):419-34
15741312
Bioinformatics. 2006 Mar 1;22(5):634-6
16403790
Anal Chem. 2006 Sep 1;78(17):6140-52
16944896