Comparison of two methods to detect publication bias in meta-analysis.
BACKGROUND
Egger's regression test is often used to help detect publication bias in meta-analyses. However, the performance of this test and the usual funnel plot have been challenged particularly when the summary estimate is the natural log of the odds ratio (lnOR).


OBJECTIVE
To compare the performance of Egger's regression test with a regression test based on sample size (a modification of Macaskill's test) with lnOR as the summary estimate.


METHODS
Simulation of meta-analyses under a number of scenarios in the presence and absence of publication bias and between-study heterogeneity.


METHODS
Type I error rates (the proportion of false-positive results) for each regression test and their power to detect publication bias when it is present (the proportion of true-positive results).


RESULTS
Type I error rates for Egger's regression test are higher than those for the alternative regression test. The alternative regression test has the appropriate type I error rates regardless of the size of the underlying OR, the number of primary studies in the meta-analysis, and the level of between-study heterogeneity. The alternative regression test has comparable power to Egger's regression test to detect publication bias under conditions of low between-study heterogeneity.


CONCLUSIONS
Because of appropriate type I error rates and reduction in the correlation between the lnOR and its variance, the alternative regression test can be used in place of Egger's regression test when the summary estimates are lnORs.
Peters
Jaime L
JL
Centre for Biostatistics and Genetic Epidemiology, Department of Health Sciences, University of Leicester, Leicester, England. jlp9@leicester.ac.uk
Sutton
Alex J
AJ
Jones
David R
DR
Abrams
Keith R
KR
Rushton
Lesley
L
D015201:Meta-Analysis as Topic; D017594:Publication Bias; D012044:Regression Analysis; D012107:Research Design