title: Evaluating effects of developmental education for college students using a regression discontinuity design.
abstract: BACKGROUND
  Annually, American colleges and universities provide developmental education (DE) to millions of underprepared students; however, evaluation estimates of DE benefits have been mixed.
  
  
  OBJECTIVE
  Using a prototypic exemplar of DE, our primary objective was to investigate the utility of a replicative evaluative framework for assessing program effectiveness.
  
  
  METHODS
  Within the context of the regression discontinuity (RD) design, this research examined the effectiveness of a DE program for five, sequential cohorts of first-time college students. Discontinuity estimates were generated for individual terms and cumulatively, across terms.
  
  
  METHODS
  Participants were 3,589 first-time community college students.
  
  
  METHODS
  DE program effects were measured by contrasting both college-level English grades and a dichotomous measure of pass/fail, for DE and non-DE students.
  
  
  RESULTS
  Parametric and nonparametric estimates of overall effect were positive for continuous and dichotomous measures of achievement (grade and pass/fail). The variability of program effects over time was determined by tracking results within individual terms and cumulatively, across terms. Applying this replication strategy, DE's overall impact was modest (an effect size of approximately .20) but quite consistent, based on parametric and nonparametric estimation approaches. A meta-analysis of five RD results yielded virtually the same estimate as the overall, parametric findings. Subset analysis, though tentative, suggested that males benefited more than females, while academic gains were comparable for different ethnicities.
  
  
  CONCLUSIONS
  The cumulative, within-study comparison, replication approach offers considerable potential for the evaluation of new and existing policies, particularly when effects are relatively small, as is often the case in applied settings.
authors.affiliation: Department of Sociology, Wayne State University, Detroit, MI, USA.
authors.forename: Brian G
authors.initials: BG
authors.lastname: Moss
authors.forename: William H
authors.initials: WH
authors.lastname: Yeaton
mesh_terms: D000328:Adult; D005260:Female; D006801:Humans; D008297:Male; D015397:Program Evaluation; D012073:Remedial Teaching / Q000458:organization & administration; D013223:Statistics as Topic; D013334:Students; D055815:Young Adult
keywords: developmental education; program evaluation; regression discontinuity; remediation; strategic planning