title: When is a program ready for rigorous impact evaluation? The role of a falsifiable logic model.
abstract: BACKGROUND
  Recent reviews suggest that many plausible programs are found to have at best small impacts not commensurate with their cost, and often have no detectable positive impacts at all. Even programs with initial rigorous impact evaluation (RIE) that show them to be effective often fail a second test with an expanded population or at multiple sites.
  
  
  OBJECTIVE
  This article argues that more rapid movement to RIE is a partial cause of the low success rate of RIE and proposes a constructive response: process evaluations that compare program intermediate outcomes--in the treatment group, during the operation of the program--against a more falsifiable extension of the conventional logic model.
  
  
  CONCLUSIONS
  Our examples suggest that such process evaluations would allow funders to deem many programs unlikely to show impacts and therefore not ready for random assignment evaluation--without the high cost and long time lines of an RIE. The article then develops the broader implications of such a process analysis step for broader evaluation strategy.
authors: American Institutes for Research, San Mateo, CA 94403, USA. diana.epstein@gmail.com
authors: Diana
authors: D
authors: Epstein
authors: Jacob Alex
authors: JA
authors: Klerman
mesh_terms: D003362:Cost-Benefit Analysis; D005069:Evaluation Studies as Topic; D006801:Humans; D016015:Logistic Models; D017145:Models, Educational; D015397:Program Evaluation / Q000191:economics / Q000379:methods*