title: Evaluating large-scale health programmes at a district level in resource-limited countries.
abstract: Recent experience in evaluating large-scale global health programmes has highlighted the need to consider contextual differences between sites implementing the same intervention. Traditional randomized controlled trials are ill-suited for this purpose, as they are designed to identify whether an intervention works, not how, when and why it works. In this paper we review several evaluation designs that attempt to account for contextual factors that contribute to intervention effectiveness. Using these designs as a base, we propose a set of principles that may help to capture information on context. Finally, we propose a tool, called a driver diagram, traditionally used in implementation that would allow evaluators to systematically monitor changing dynamics in project implementation and identify contextual variation across sites. We describe an implementation-related example from South Africa to underline the strengths of the tool. If used across multiple sites and multiple projects, the resulting driver diagrams could be pooled together to form a generalized theory for how, when and why a widely-used intervention works. Mechanisms similar to the driver diagram are urgently needed to complement existing evaluations of large-scale implementation efforts.
authors.affiliation: Institute for Healthcare Improvement, 20 University Road, Cambridge, MA 02138, United States of America. teddy.svoronos@gmail.com
authors.forename: Theodore
authors.initials: T
authors.lastname: Svoronos
authors.forename: Kedar S
authors.initials: KS
authors.lastname: Mate
mesh_terms: D003906:Developing Countries / Q000706:statistics & numerical data*; D005843:Geography; D014943:Global Health; D006293:Health Promotion / Q000379:methods* / Q000706:statistics & numerical data; D006302:Health Services Research / Q000379:methods; D006801:Humans; D007182:Income; D011203:Poverty / Q000706:statistics & numerical data*; D016730:Program Development; D015397:Program Evaluation; D011634:Public Health / Q000379:methods; D012189:Retrospective Studies; D040241:Social Marketing; D012959:Socioeconomic Factors; D013019:South Africa
references.citation: JAMA. 2011 Jan 26;305(4):400-1
references.pmid: 21266687
references.citation: J Am Med Dir Assoc. 2011 Jun;12(5):331-6
references.pmid: 21450245
references.citation: Implement Sci. 2009 Aug 07;4:50
references.pmid: 19664226
references.citation: Health Educ Res. 1998 Jun;13(2):225-38
references.pmid: 10181021
references.citation: BMC Health Serv Res. 2010 Jan 25;10:24
references.pmid: 20100330
references.citation: Health Educ Res. 2005 Oct;20(5):499-513
references.pmid: 15613492
references.citation: Lancet. 2010 May 1;375(9725):1521; author reply 1522
references.pmid: 20435222
references.citation: Am J Public Health. 2004 Mar;94(3):400-5
references.pmid: 14998803
references.citation: BMJ Qual Saf. 2011 Apr;20(4):372-80
references.pmid: 21317180
references.citation: Milbank Q. 2009 Jun;87(2):391-416
references.pmid: 19523123
references.citation: Int J Qual Health Care. 2007 Apr;19(2):57-9
references.pmid: 17337518
references.citation: Lancet. 2004 Oct 30-Nov 5;364(9445):1595-602
references.pmid: 15519629
references.citation: J Epidemiol Community Health. 2004 Sep;58(9):788-93
references.pmid: 15310806
references.citation: Qual Saf Health Care. 2003 Jun;12(3):210-4
references.pmid: 12792012
references.citation: BMJ. 2006 Feb 18;332(7538):413-6
references.pmid: 16484270
references.citation: Diabet Med. 2008 Aug;25(8):960-7
references.pmid: 18959610
references.citation: Ann Intern Med. 2009 Aug 4;151(3):206-9
references.pmid: 19567619
references.citation: Am J Trop Med Hyg. 2009 Jun;80(6):971-9
references.pmid: 19478260
references.citation: Lancet. 2010 Feb 13;375(9714):572-82
references.pmid: 20071020
references.citation: Qual Saf Health Care. 2003 Dec;12(6):458-64
references.pmid: 14645763
references.citation: Lancet. 2011 Jan 1;377(9759):85-95
references.pmid: 20619886
references.citation: Lancet. 2010 Feb 13;375(9714):530-1
references.pmid: 20071022
references.citation: J Clin Pharm Ther. 2002 Aug;27(4):299-309
references.pmid: 12174032
references.citation: BMC Public Health. 2011 May 09;11:284
references.pmid: 21549018
references.citation: CMAJ. 1995 Nov 15;153(10):1423-31
references.pmid: 7585368
references.citation: BMJ. 2003 Apr 5;326(7392):759-61
references.pmid: 12676849
references.citation: Jt Comm J Qual Patient Saf. 2009 Apr;35(4):192-8
references.pmid: 19435158
references.citation: J Epidemiol Community Health. 2007 Mar;61(3):254-61
references.pmid: 17325405
references.citation: Int J Epidemiol. 1999 Feb;28(1):10-8
references.pmid: 10195658
references.citation: JAMA. 2009 Aug 26;302(8):894-5
references.pmid: 19706865
references.citation: PLoS Med. 2008 Mar 11;5(3):e67
references.pmid: 18336067
references.citation: Age Ageing. 1990 Jan;19(1):11-8
references.pmid: 2316419
references.citation: BMJ. 2000 Sep 16;321(7262):694-6
references.pmid: 10987780
references.citation: Am J Public Health. 1981 Jan;71(1):38-46
references.pmid: 7258429
references.citation: Jt Comm J Qual Patient Saf. 2009 Nov;35(11):535-43
references.pmid: 19947329
references.citation: J Eval Clin Pract. 2011 Feb;17(1):180-7
references.pmid: 20846278
references.citation: JAMA. 2009 Dec 16;302(23):2580-6
references.pmid: 20009058
references.citation: Science. 2007 Dec 14;318(5857):1728-9
references.pmid: 18079386
references.citation: Eval Rev. 2000 Aug;24(4):407-31
references.pmid: 11009866