Using cluster random assignment to measure program impacts. Statistical implications for the evaluation of education programs.
This article explores the possibility of randomly assigning groups (or clusters) of individuals to a program or a control group to estimate the impacts of programs designed to affect whole groups. This cluster assignment approach maintains the primary strength of random assignment--the provision of unbiased impact estimates--but has less statistical power than random assignment of individuals, which usually is not possible for programs focused on whole groups. To explore the statistical implications of cluster assignment, the authors (a) outline the issues involved, (b) present an analytic framework for studying these issues, and (c) apply this framework to assess the potential for using the approach to evaluate education programs targeted on whole schools. The findings suggest that cluster assignment of schools holds some promise for estimating the impacts of education programs when it is possible to control for the average performance of past student cohorts or the past performance of individual students.
Bloom
H S
HS
Manpower Demonstration Research Corporation, USA. howard_bloom@mdrc.org
Bos
J M
JM
Lee
S W
SW
D015982:Bias; D002648:Child; D016000:Cluster Analysis; D003627:Data Interpretation, Statistical; D004493:Education / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D015987:Effect Modifier, Epidemiologic; D006801:Humans; D008137:Longitudinal Studies; D015233:Models, Statistical; D009518:New York; D015397:Program Evaluation / Q000379:methods*; D016032:Randomized Controlled Trials as Topic; D015203:Reproducibility of Results; D012107:Research Design