title: Assessing fidelity of delivery of smoking cessation behavioural support in practice.
abstract: BACKGROUND
  Effectiveness of evidence-based behaviour change interventions is likely to be undermined by failure to deliver interventions as planned. Behavioural support for smoking cessation can be a highly cost-effective, life-saving intervention. However, in practice, outcomes are highly variable. Part of this may be due to variability in fidelity of intervention implementation. To date, there have been no published studies on this. The present study aimed to: evaluate a method for assessing fidelity of behavioural support; assess fidelity of delivery in two English Stop-Smoking Services; and compare the extent of fidelity according to session types, duration, individual practitioners, and component behaviour change techniques (BCTs).
  
  
  METHODS
  Treatment manuals and transcripts of 34 audio-recorded behavioural support sessions were obtained from two Stop-Smoking Services and coded into component BCTs using a taxonomy of 43 BCTs. Inter-rater reliability was assessed using percentage agreement. Fidelity was assessed by examining the proportion of BCTs specified in the manuals that were delivered in individual sessions. This was assessed by session type (i.e., pre-quit, quit, post-quit), duration, individual practitioner, and BCT.
  
  
  RESULTS
  Inter-coder reliability was high (87.1%). On average, 66% of manual-specified BCTs were delivered per session (SD 15.3, range: 35% to 90%). In Service 1, average fidelity was highest for post-quit sessions (69%) and lowest for pre-quit (58%). In Service 2, fidelity was highest for quit-day (81%) and lowest for post-quit sessions (56%). Session duration was not significantly correlated with fidelity. Individual practitioner fidelity ranged from 55% to 78%. Individual manual-specified BCTs were delivered on average 63% of the time (SD 28.5, range: 0 to 100%).
  
  
  CONCLUSIONS
  The extent to which smoking cessation behavioural support is delivered as specified in treatment manuals can be reliably assessed using transcripts of audiotaped sessions. This allows the investigation of the implementation of evidence-based practice in relation to smoking cessation, a first step in designing interventions to improve it. There are grounds for believing that fidelity in the English Stop-Smoking Services may be low and that routine monitoring is warranted.
authors.affiliation: University College London, London, UK. fabi.lorencatto@ncsct.co.uk
authors.forename: Fabiana
authors.initials: F
authors.lastname: Lorencatto
authors.forename: Robert
authors.initials: R
authors.lastname: West
authors.forename: Charlotte
authors.initials: C
authors.lastname: Christopherson
authors.forename: Susan
authors.initials: S
authors.lastname: Michie
mesh_terms: D001521:Behavior Therapy / Q000379:methods*; D002965:Classification / Q000379:methods; D003695:Delivery of Health Care / Q000458:organization & administration*; D019317:Evidence-Based Medicine; D058006:General Practice / Q000592:standards; D006801:Humans; D009042:Motivation; D015588:Observer Variation; D011364:Professional Practice / Q000592:standards; D011787:Quality of Health Care / Q000592:standards; D016540:Smoking Cessation / Q000379:methods*
references.citation: Behav Res Ther. 1996 Apr;34(4):295-314
references.pmid: 8871362
references.citation: Addict Behav. 2011 Apr;36(4):315-9
references.pmid: 21215528
references.citation: Health Educ Res. 2003 Apr;18(2):237-56
references.pmid: 12729182
references.citation: Cochrane Database Syst Rev. 2005 Apr 18;(2):CD001292
references.pmid: 15846616
references.citation: Soc Sci Med. 2010 May;70(10):1618-25
references.pmid: 20207464
references.citation: Addiction. 2012 Nov;107(11):2029-36
references.pmid: 22571648
references.citation: BMC Health Serv Res. 2012 May 23;12:121
references.pmid: 22621715
references.citation: Psychol Health. 2008;23(1):11-24
references.pmid: 25159904
references.citation: Cochrane Database Syst Rev. 2006 Jul 19;(3):CD002850
references.pmid: 16855992
references.citation: Am J Community Psychol. 2008 Jun;41(3-4):327-50
references.pmid: 18322790
references.citation: Nicotine Tob Res. 2012 Sep;14(9):1019-26
references.pmid: 22318690
references.citation: Addiction. 2012 Aug;107(8):1431-40
references.pmid: 22340523
references.citation: Nicotine Tob Res. 2010 Jul;12(7):742-7
references.pmid: 20478957
references.citation: Implement Sci. 2009 Apr 07;4:18
references.pmid: 19351400
references.citation: Behav Res Ther. 2011 Nov;49(11):815-20
references.pmid: 21939960
references.citation: Cochrane Database Syst Rev. 2005 Apr 18;(2):CD001007
references.pmid: 15846610
references.citation: Ann Behav Med. 2011 Feb;41(1):59-70
references.pmid: 20936389
references.citation: Ann Intern Med. 2008 Feb 19;148(4):295-309
references.pmid: 18283207
references.citation: Int J Clin Pharmacol Ther. 1997 Mar;35(3):93-5
references.pmid: 9088995
references.citation: J Am Acad Child Adolesc Psychiatry. 2008 Sep;47(9):987-93
references.pmid: 18714195
references.citation: Health Psychol. 2004 Sep;23(5):452-6
references.pmid: 15367064
references.citation: Implement Sci. 2011 Feb 07;6:10
references.pmid: 21299860
references.citation: Thorax. 2000 Dec;55(12):987-99
references.pmid: 11083883
references.citation: Addiction. 2009 Feb;104(2):279-87
references.pmid: 19149825
references.citation: Psychol Health. 2011 Nov;26(11):1479-98
references.pmid: 21678185
references.citation: Addiction. 2005 Apr;100 Suppl 2:59-69
references.pmid: 15755262
references.citation: Clin Psychol Rev. 1998 Jan;18(1):23-45
references.pmid: 9455622
references.citation: Am J Prev Med. 2001 Nov;21(4):272-7
references.pmid: 11701297
references.citation: J Public Health Dent. 2011 Winter;71(s1):S52-S63
references.pmid: 21499543
references.citation: J Consult Clin Psychol. 2013 Jun;81(3):528-44
references.pmid: 23506465
references.citation: Alcohol Alcohol. 2008 Nov-Dec;43(6):675-82
references.pmid: 18818190
references.citation: Health Psychol. 2004 Sep;23(5):443-51
references.pmid: 15367063