title: A framework of the desirable features of guideline implementation tools (GItools): Delphi survey and assessment of GItools.
abstract: BACKGROUND
  Guidelines are the foundation for healthcare planning, delivery and quality improvement but are not consistently implemented. Few guidelines are accompanied by guideline implementation tools (GItools). Users have requested GItools, and developers have requested guidance on how to develop GItools. First it is necessary to characterize GItools. The purpose of this research was to generate a framework of desirable features of GItools.
  
  
  METHODS
  Items representing desirable GItool features were generated by a cross-sectional survey of the international guideline community. Items were confirmed by 31 guideline developers, implementers and researchers in a two-round Delphi survey administered on the Internet. The resulting GItool framework was applied with a sample of GItools accompanying guidelines identified in the National Guideline Clearinghouse.
  
  
  RESULTS
  The cross-sectional survey was completed by 96 respondents from Australia, Canada, the United Kingdom, the United States, The Netherlands, and various other countries. Seven of nine items were rated by the majority as desirable. A total of 31 panelists from 10 countries including Australia, Canada, Germany, New Zealand, Peru, Saudi Arabia, Spain, the United Kingdom, and the United States took part in a two-round Delphi survey. Ten items achieved consensus as desirable GItool features in round #1, and two additional items in round #2. A total of 13 GItools for Resource Planning, Implementation and Evaluation were identified among 149 guidelines on a variety of clinical topics (8.7%). Many GItools did not possess features considered desirable.
  
  
  CONCLUSIONS
  Inclusion of higher quality GItools in guidelines is needed to support user adoption of guidelines. The GItool framework can serve as the basis for evaluating and adapting existing GItools, or developing new GItools. Further research is needed to validate the framework, develop and implement instruments by which developers can apply the framework, and specify which guidelines should be accompanied by GItools.
authors.affiliation: University Health Network, Toronto, ON, Canada. anna.gagliardi@uhnresearch.ca.
authors.forename: Anna R
authors.initials: AR
authors.lastname: Gagliardi
authors.forename: Melissa C
authors.initials: MC
authors.lastname: Brouwers
authors.forename: Onil K
authors.initials: OK
authors.lastname: Bhattacharyya
mesh_terms: D003430:Cross-Sectional Studies; D003697:Delphi Technique; D019983:Guideline Adherence / Q000458:organization & administration / Q000592:standards; D006801:Humans; D017410:Practice Guidelines as Topic / Q000592:standards; D016730:Program Development / Q000592:standards
references.citation: Milbank Q. 2007 Dec;85(4):691-727
references.pmid: 18070334
references.citation: Implement Sci. 2011 Mar 22;6:26
references.pmid: 21426574
references.citation: PLoS One. 2013 Dec 09;8(12):e82915
references.pmid: 24349397
references.citation: Health Policy. 2013 Feb;109(2):187-91
references.pmid: 23228520
references.citation: Postgrad Med J. 2011 Oct;87(1032):670-9
references.pmid: 21715571
references.citation: Implement Sci. 2009 Sep 23;4:61
references.pmid: 19775439
references.citation: J Clin Epidemiol. 2010 Dec;63(12):1308-11
references.pmid: 20656455
references.citation: BMC Health Serv Res. 2012 Nov 15;12:404
references.pmid: 23153052
references.citation: BMJ. 1995 Aug 5;311(7001):376-80
references.pmid: 7640549
references.citation: PLoS One. 2011;6(6):e20476
references.pmid: 21694759
references.citation: Implement Sci. 2012 Jul 23;7:67
references.pmid: 22824094
references.citation: BMJ. 2004 Oct 30;329(7473):999
references.pmid: 15514342
references.citation: J Contin Educ Health Prof. 2007 Spring;27(2):94-102
references.pmid: 17576625
references.citation: Implement Sci. 2009 Aug 05;4:49
references.pmid: 19656384
references.citation: Am J Prev Med. 2007 May;32(5 Suppl):S90-6
references.pmid: 17466824
references.citation: CMAJ. 2014 Feb 18;186(3):E123-42
references.pmid: 24344144
references.citation: Health Serv Res. 2000 Mar;34(7):1429-48
references.pmid: 10737446
references.citation: J Biomed Inform. 2001 Feb;34(1):52-66
references.pmid: 11376543
references.citation: BMC Med Inform Decis Mak. 2005 Jul 27;5:23
references.pmid: 16048653
references.citation: Evid Based Med. 2008 Dec;13(6):162-3
references.pmid: 19043023
references.citation: JAMA. 2013 Dec 18;310(23):2501-2
references.pmid: 24310916
references.citation: Evid Based Med. 2007 Feb;12(1):4-7
references.pmid: 17264256
references.citation: Am J Public Health. 1984 Sep;74(9):979-83
references.pmid: 6380323
references.citation: Implement Sci. 2012 Jul 04;7:62
references.pmid: 22762242
references.citation: Int J Qual Health Care. 2003 Jun;15(3):261-6
references.pmid: 12803354
references.citation: N Engl J Med. 2003 Jun 26;348(26):2635-45
references.pmid: 12826639
references.citation: Prim Health Care Res Dev. 2012 Jan;13(1):48-59
references.pmid: 22008308
references.citation: Int J Qual Health Care. 2003 Feb;15(1):31-45
references.pmid: 12630799
references.citation: Milbank Q. 2012 Jun;90(2):311-46
references.pmid: 22709390