Comparing meta-analytic moderator estimation techniques under realistic conditions.
One of the most problematic issues in contemporary meta-analysis is the estimation and interpretation of moderating effects. Monte Carlo analyses are developed in this article that compare bivariate correlations, ordinary least squares and weighted least squares (WLS) multiple regression, and hierarchical subgroup (HS) analysis for assessing the influence of continuous moderators under conditions of multicollinearity and skewed distribution of study sample sizes (heteroscedasticity). The results show that only WLS is largely unaffected by multicollinearity and heteroscedasticity, whereas the other techniques are substantially weakened. Of note, HS, one of the most popular methods, typically provides the most inaccurate results, whereas WLS, one of the least popular methods, typically provides the most accurate results.
Steel
Piers D
PD
Department of Psychology, University of Minnesota, Minneapolis 55455, USA.
Kammeyer-Mueller
John D
JD
D006801:Humans; D015201:Meta-Analysis as Topic; D008962:Models, Theoretical; D009010:Monte Carlo Method; D011590:Psychology, Industrial; D015203:Reproducibility of Results