"Smallball" evaluation: a prescription for studying community-based information interventions.
OBJECTIVE
This paper argues that focused evaluation studies of community-based informational interventions conducted over the life-cycle of the project ("smallball" studies) are more informative and useful than randomized experiments conducted only at the project's conclusion ("powerball" studies).


METHODS
Based on two contrasting strategies in baseball, smallball and powerball studies are compared and contrasted, emphasizing how the distinctive features of community-based interventions lend advantage to smallball approaches.


RESULTS
Smallball evaluations have several important advantages over powerball evaluations: before system development, they ensure that information resources address real community needs; during deployment, they ensure that the systems are suited to the capabilities of the users and to community constraints; and, after deployment, they enable as much as possible to be learned about the effects of the intervention in environments where randomized studies are usually impossible.


CONCLUSIONS
Many in informatics see powerball studies as the only legitimate form of evaluation and so expect powerball studies to be done. These expectations should be revised in favor of smallball studies.
Friedman
Charles P
CP
National Library of Medicine, 6705 Rockledge Drive, Suite 301, Rockledge, MD 20892, USA. friedmc1@mail.nih.gov
D018672:Community Health Planning / Q000592:standards* / Q000706:statistics & numerical data; D019058:Community Networks / Q000458:organization & administration*; D003159:Community-Institutional Relations / Q000592:standards*; D004059:Diffusion of Innovation; D006266:Health Education / Q000458:organization & administration*; D006293:Health Promotion / Q000458:organization & administration; D006801:Humans; D018966:Library Materials / Q000592:standards; D007999:Library Services / Q000592:standards / Q000706:statistics & numerical data; D009937:Organizational Objectives; D010043:Outcome and Process Assessment, Health Care; D015397:Program Evaluation / Q000379:methods*; D016032:Randomized Controlled Trials as Topic; D012107:Research Design; D014481:United States