title: Ridge regression in prediction problems: automatic choice of the ridge parameter.
abstract: To date, numerous genetic variants have been identified as associated with diverse phenotypic traits. However, identified associations generally explain only a small proportion of trait heritability and the predictive power of models incorporating only known-associated variants has been small. Multiple regression is a popular framework in which to consider the joint effect of many genetic variants simultaneously. Ordinary multiple regression is seldom appropriate in the context of genetic data, due to the high dimensionality of the data and the correlation structure among the predictors. There has been a resurgence of interest in the use of penalised regression techniques to circumvent these difficulties. In this paper, we focus on ridge regression, a penalised regression approach that has been shown to offer good performance in multivariate prediction problems. One challenge in the application of ridge regression is the choice of the ridge parameter that controls the amount of shrinkage of the regression coefficients. We present a method to determine the ridge parameter based on the data, with the aim of good performance in high-dimensional prediction problems. We establish a theoretical justification for our approach, and demonstrate its performance on simulated genetic data and on a real data example. Fitting a ridge regression model to hundreds of thousands to millions of genetic variants simultaneously presents computational challenges. We have developed an R package, ridge, which addresses these issues. Ridge implements the automatic choice of ridge parameter presented in this paper, and is freely available from CRAN.
authors.affiliation: Department of Epidemiology and Biostatistics, Imperial College London, London, United Kingdom; Statistical Consulting Group, GlaxoSmithKline, Stevenage, United Kingdom.
authors.forename: Erika
authors.initials: E
authors.lastname: Cule
authors.forename: Maria
authors.initials: M
authors.lastname: De Iorio
mesh_terms: D000465:Algorithms; D001714:Bipolar Disorder / Q000235:genetics; D020022:Genetic Predisposition to Disease / Q000235:genetics; D014644:Genetic Variation / Q000235:genetics*; D005838:Genotype; D006801:Humans; D008957:Models, Genetic; D010641:Phenotype; D020641:Polymorphism, Single Nucleotide / Q000235:genetics; D012372:ROC Curve; D012044:Regression Analysis; D012984:Software
keywords: GWAS; penalised regression; prediction; shrinkage methods; software
references.citation: Arch Gen Psychiatry. 2003 May;60(5):497-502
references.pmid: 12742871
references.citation: Mol Psychiatry. 2009 Aug;14(8):755-63
references.pmid: 19488044
references.citation: Genetics. 2007 Nov;177(3):1725-31
references.pmid: 17947444
references.citation: Genet Sel Evol. 2009 Dec 31;41:56
references.pmid: 20043835
references.citation: Proc Natl Acad Sci U S A. 2009 Jun 9;106(23):9362-7
references.pmid: 19474294
references.citation: Genet Epidemiol. 2010 Dec;34(8):879-91
references.pmid: 21104890
references.citation: PLoS Genet. 2008 Jul 25;4(7):e1000130
references.pmid: 18654633
references.citation: BMC Bioinformatics. 2012;13 Suppl 14:S6
references.pmid: 23095471
references.citation: Genetics. 2001 Apr;157(4):1819-29
references.pmid: 11290733
references.citation: Am J Hum Genet. 2007 Sep;81(3):559-75
references.pmid: 17701901
references.citation: Nat Genet. 2006 Aug;38(8):904-9
references.pmid: 16862161
references.citation: Genetics. 2013 Feb;193(2):327-45
references.pmid: 22745228
references.citation: Mol Psychiatry. 2008 Aug;13(8):742-71
references.pmid: 18332878
references.citation: Curr Psychiatry Rep. 2011 Dec;13(6):522-7
references.pmid: 21837483
references.citation: Nat Rev Genet. 2010 Jun;11(6):446-50
references.pmid: 20479774
references.citation: BMC Bioinformatics. 2008 Sep 08;9:364
references.pmid: 18778480
references.citation: PLoS Genet. 2011 Apr;7(4):e1002051
references.pmid: 21552331
references.citation: J Stat Softw. 2010;33(1):1-22
references.pmid: 20808728
references.citation: Am J Epidemiol. 2004 Aug 15;160(4):301-5
references.pmid: 15286014
references.citation: BMC Bioinformatics. 2012 Jun 11;13 Suppl 9:S5
references.pmid: 22901090
references.citation: PLoS Genet. 2009 Jun;5(6):e1000529
references.pmid: 19543373
references.citation: PLoS One. 2009 Nov 30;4(11):e8068
references.pmid: 19956648
references.citation: Nature. 2007 Jun 7;447(7145):661-78
references.pmid: 17554300
references.citation: Genet Epidemiol. 2013 Feb;37(2):184-95
references.pmid: 23203348
references.citation: Nat Genet. 2007 Jul;39(7):906-13
references.pmid: 17572673
references.citation: Int J Biostat. 2008 Sep 29;4(1):Article 19
references.pmid: 20231910
references.citation: Nat Genet. 2010 Jul;42(7):565-9
references.pmid: 20562875
references.citation: Philos Trans R Soc Lond B Biol Sci. 2005 Aug 29;360(1460):1571-2
references.pmid: 16096105
references.citation: Am J Hum Genet. 2008 Feb;82(2):375-85
references.pmid: 18252218