Multivariate meta-analysis: potential and promise.
The multivariate random effects model is a generalization of the standard univariate model. Multivariate meta-analysis is becoming more commonly used and the techniques and related computer software, although continually under development, are now in place. In order to raise awareness of the multivariate methods, and discuss their advantages and disadvantages, we organized a one day 'Multivariate meta-analysis' event at the Royal Statistical Society. In addition to disseminating the most recent developments, we also received an abundance of comments, concerns, insights, critiques and encouragement. This article provides a balanced account of the day's discourse. By giving others the opportunity to respond to our assessment, we hope to ensure that the various view points and opinions are aired before multivariate meta-analysis simply becomes another widely used de facto method without any proper consideration of it by the medical statistics community. We describe the areas of application that multivariate meta-analysis has found, the methods available, the difficulties typically encountered and the arguments for and against the multivariate methods, using four representative but contrasting examples. We conclude that the multivariate methods can be useful, and in particular can provide estimates with better statistical properties, but also that these benefits come at the price of making more assumptions which do not result in better inference in every case. Although there is evidence that multivariate meta-analysis has considerable potential, it must be even more carefully applied than its univariate counterpart in practice.
MRC Biostatistics Unit, Cambridge, U.K.. daniel.jackson@mrc-bsu.cam.ac.uk.
Dan
D
Jackson
Richard
R
Riley
Ian R
IR
White
D002294:Carcinoma, Squamous Cell / Q000097:blood; D002318:Cardiovascular Diseases / Q000175:diagnosis; D002872:Chromosome Deletion; D025063:Chromosome Disorders / Q000097:blood; D002878:Chromosomes, Human, Pair 1; D003198:Computer Simulation; D018572:Disease-Free Survival; D004562:Electrocardiography; D006801:Humans; D015201:Meta-Analysis as Topic; D015233:Models, Statistical; D015999:Multivariate Analysis; D000071447:N-Myc Proto-Oncogene Protein; D009447:Neuroblastoma / Q000473:pathology; D009687:Nuclear Proteins / Q000097:blood; D015513:Oncogene Proteins / Q000097:blood; D009959:Oropharyngeal Neoplasms / Q000097:blood
C459801:MYCN protein, human; D000071447:N-Myc Proto-Oncogene Protein; D009687:Nuclear Proteins; D015513:Oncogene Proteins
J Clin Epidemiol. 2009 Dec;62(12):1292-300
19447007
Stat Med. 1993 Dec 30;12(24):2273-84
7907813
Stat Med. 1997 Sep 15;16(17):1965-82
9304767
Stat Med. 1996 Mar 15;15(5):537-57
8668877
Stat Med. 2001 Aug 15;20(15):2219-41
11468761
Stat Med. 2008 Feb 10;27(3):418-34
17477434
Stat Med. 2008 Dec 20;27(29):6111-36
18816508
J Clin Epidemiol. 2005 Oct;58(10):982-90
16168343
Stat Med. 2005 Jul 30;24(14):2241-54
15887296
Stat Med. 2008 Feb 28;27(5):670-86
17492826
Biometrics. 1997 Sep;53(3):983-97
9333350
Stat Med. 2005 Aug 15;24(15):2401-28
16015676
Heart. 2003 Nov;89(11):1327-34
14594892
J Clin Epidemiol. 2008 Jan;61(1):41-51
18083461
Control Clin Trials. 1986 Sep;7(3):177-88
3802833
Biostatistics. 2007 Apr;8(2):239-51
16698768
Stat Med. 2002 Jun 15;21(11):1539-58
12111919
Stat Med. 2002 Aug 30;21(16):2313-24
12210616
Biostatistics. 2003 Jul;4(3):423-31
12925509
BMC Med Res Methodol. 2009 Nov 10;9:73
19903336
Stat Med. 2009 Apr 15;28(8):1218-37
19222087
Stat Med. 2005 May 15;24(9):1307-19
15685717
Biostatistics. 2008 Jan;9(1):172-86
17626226
Stat Med. 2008 Sep 30;27(22):4381-96
18465839
Stat Med. 1996 Mar 30;15(6):619-29
8731004
BMJ. 1995 Mar 25;310(6982):752-4
7711568
Clin Trials. 2009 Feb;6(1):16-27
19254930
Stat Med. 2001 Aug 15;20(15):2243-60
11468762
BMJ. 1997 Nov 22;315(7119):1371-4
9432250
Stat Med. 1999 Feb 15;18(3):321-59
10070677
Stat Med. 1998 Nov 30;17(22):2537-50
9839346
Stat Methods Med Res. 2008 Jun;17(3):279-301
17925316
J R Stat Soc Ser A Stat Soc. 2009 Jan;172(1):137-159
19381330
Biometrics. 1986 Dec;42(4):805-20
3814725
Biom J. 2010 Feb;52(1):95-110
19924701
J Clin Epidemiol. 2006 Dec;59(12):1331-2; author reply 1332-3
17098577
Biostatistics. 2000 Sep;1(3):231-46
12933506
Stat Med. 2003 Jul 30;22(14):2309-33
12854095
BMC Med Res Methodol. 2007 Jan 12;7:3
17222330
J Dent Res. 1995 Apr;74(4):1030-9
7782533
J Pediatr Surg. 1998 Nov;33(11):1695-8
9856898
Res Synth Methods. 2010 Jan;1(1):39-65
26056092
Stat Med. 2010 May 30;29(12):1325-39
20101670
Stat Med. 2010 Jun 30;29(14):1502-10
20087877
J Clin Epidemiol. 2004 Sep;57(9):911-24
15504634
Lancet. 2010 Jun 26;375(9733):2215-22
20609967
Stat Med. 1999 Oct 30;18(20):2693-708
10521860
Stat Med. 2007 Jan 15;26(1):78-97
16526010
BMJ. 1994 Sep 24;309(6957):789-92
7950571
Cancer Epidemiol Biomarkers Prev. 2010 Feb;19(2):574-87
20142252
Stat Med. 2001 Oct 15;20(19):2865-84
11568945
Stat Med. 2002 Feb 28;21(4):589-624
11836738
Stat Med. 2008 Sep 20;27(21):4279-300
18416445
Stat Med. 2009 Aug 15;28(18):2384-99
19499551
Stat Med. 2010 May 30;29(12):1282-97
19408255
Stat Med. 2000 Dec 30;19(24):3417-32
11122505
Health Care Manag Sci. 2008 Jun;11(2):121-31
18581818