title: A correction for recruitment bias in norms derived from meta-analysis.
abstract: Normative comparisons are an integral component of neuropsychological test interpretation and provide the basis for an inference of abnormal function and impairment. In order to remedy a deficit of normative standards for a large number of neuropsychology tests, Mitrushina, Boone, Razani, and D'Elia (2005) used the meta-analysis of studies that incorporated normal volunteers to create a type of normative standard for many tests in neuropsychology that were not adequately normed in the past. The present study examined this method by contrasting meta-analysis norms of the Wechsler Adult Intelligence Scale-Revised (WAIS-R; Wechsler, 1981) with its published quota norms. The study examined 12 experimental studies of the WAIS-R that included normal, control volunteers (N = 2,147). These were combined by meta-analysis, and the summary scores were compared. The meta-analysis revealed a significant sampling bias with studies recruiting more White and higher educated respondents than indicated by the U.S. Census. This bias was successfully corrected using Monte Carlo simulation and adjustments for quota sampling. The corrections could be applied to all meta-analysis norms currently in use and bring them in line with the U.S. Census demographics.
authors.affiliation: Department of Psychology, Drexel University, Philadelphia, PA 19104, USA. jw37@drexel.edu
authors.forename: J Michael
authors.initials: JM
authors.lastname: Williams
authors.forename: Cindy C
authors.initials: CC
authors.lastname: Cottle
mesh_terms: D000293:Adolescent; D000328:Adult; D000368:Aged; D019352:Censuses; D002648:Child; D035061:Control Groups; D003627:Data Interpretation, Statistical; D003710:Demography; D004522:Educational Status; D005260:Female; D006801:Humans; D008297:Male; D015201:Meta-Analysis as Topic; D008875:Middle Aged; D009010:Monte Carlo Method; D011581:Psychological Tests / Q000592:standards* / Q000706:statistics & numerical data; D012015:Reference Standards; D012044:Regression Analysis; D015983:Selection Bias; D014481:United States; D014888:Wechsler Scales / Q000592:standards / Q000706:statistics & numerical data; D055815:Young Adult