title: Introduction of a new critical p value correction method for statistical significance analysis of metabonomics data.
abstract: Nuclear magnetic resonance (NMR) spectroscopy-based metabonomics is of growing importance for discovery of human disease biomarkers. Identification and validation of disease biomarkers using statistical significance analysis (SSA) is critical for translation to clinical practice. SSA is performed by assessing a null hypothesis test using a derivative of the Student's t test, e.g., a Welch's t test. Choosing how to correct the significance level for rejecting null hypotheses in the case of multiple testing to maintain a constant family-wise type I error rate is a common problem in such tests. The multiple testing problem arises because the likelihood of falsely rejecting the null hypothesis, i.e., a false positive, grows as the number of tests applied to the same data set increases. Several methods have been introduced to address this problem. Bonferroni correction (BC) assumes all variables are independent and therefore sacrifices sensitivity for detecting true positives in partially dependent data sets. False discovery rate (FDR) methods are more sensitive than BC but uniformly ascribe highest stringency to lowest p value variables. Here, we introduce standard deviation step down (SDSD), which is more sensitive and appropriate than BC for partially dependent data sets. Sensitivity and type I error rate of SDSD can be adjusted based on the degree of variable dependency. SDSD generates fundamentally different profiles of critical p values compared with FDR methods potentially leading to reduced type II error rates. SDSD is increasingly sensitive for more concentrated metabolites. SDSD is demonstrated using NMR-based metabonomics data collected on three different breast cancer cell line extracts.
authors.affiliation: Department of Chemistry and Biochemistry, Miami University, Oxford, OH, 45056, USA.
authors.forename: Bo
authors.initials: B
authors.lastname: Wang
authors.forename: Zhanquan
authors.initials: Z
authors.lastname: Shi
authors.forename: Georg F
authors.initials: GF
authors.lastname: Weber
authors.forename: Michael A
authors.initials: MA
authors.lastname: Kennedy
mesh_terms: D001940:Breast / Q000378:metabolism; D001943:Breast Neoplasms / Q000378:metabolism*; D045744:Cell Line, Tumor; D005189:False Positive Reactions; D005260:Female; D006801:Humans; D016018:Least-Squares Analysis; D055432:Metabolomics / Q000379:methods*; D015233:Models, Statistical; D025341:Principal Component Analysis; D011336:Probability
references.citation: Mol Syst Biol. 2008;4:219
references.pmid: 18854818
references.citation: Nat Protoc. 2007;2(11):2692-703
references.pmid: 18007604
references.citation: BMJ. 1998 Apr 18;316(7139):1236-8
references.pmid: 9553006
references.citation: J Proteome Res. 2007 Feb;6(2):469-79
references.pmid: 17269704
references.citation: Anal Chem. 2009 Aug 1;81(15):6080-8
references.pmid: 19950923
references.citation: Stat Methods Med Res. 2003 Oct;12(5):419-46
references.pmid: 14599004
references.citation: Magn Reson Chem. 2009 Dec;47 Suppl 1:S36-46
references.pmid: 19768747
references.citation: Anal Chem. 2005 Mar 1;77(5):1282-9
references.pmid: 15732908
references.citation: Anal Chim Acta. 2011 Feb 7;686(1-2):57-63
references.pmid: 21237308
references.citation: Chemometr Intell Lab Syst. 2013 Oct 15;128:9-16
references.pmid: 24678137
references.citation: BMC Genomics. 2006 Jun 08;7:142
references.pmid: 16762068
references.citation: Anal Chem. 2005 Jan 15;77(2):517-26
references.pmid: 15649048
references.citation: Bioinformatics. 2003 Feb 12;19(3):368-75
references.pmid: 12584122
references.citation: Anal Chem. 2009 Aug 1;81(15):6242-51
references.pmid: 19585975
references.citation: Anal Biochem. 2010 Jun 1;401(1):134-43
references.pmid: 20159006
references.citation: Chemometr Intell Lab Syst. 2011 Dec 15;109(2):162-170
references.pmid: 26246647
references.citation: NMR Biomed. 2008 Oct;21(8):809-19
references.pmid: 18470962
references.citation: J Nat Prod. 2004 Jun;67(6):953-7
references.pmid: 15217272
references.citation: J Magn Reson. 2006 Jan;178(1):88-95
references.pmid: 16198132
references.citation: Anal Chem. 2011 Oct 15;83(20):7616-23
references.pmid: 21894988
references.citation: Oncogene. 2006 Apr 6;25(15):2192-202
references.pmid: 16288209