Benchmarking Family Therapy for Adolescent Behavior Problems in Usual Care: Fidelity, Outcomes, and Therapist Performance Differences.
This study evaluated whether community therapists delivering family therapy for adolescent behavior problems in usual care achieved performance benchmarks established in controlled trials for treatment fidelity and outcomes, with particular focus on individual differences in therapist performance. The study contained N = 38 adolescents (50 % male; mean age 15 years) whose self-reported race/ethnicity was Hispanic (74 %), African American (11 %), multiracial (11 %), and other (4 %). Clients were treated by 13 therapists in one community mental health clinic that delivered family therapy as the routine standard of care. Therapists provided self-report data on adherence to core family therapy techniques; these scores were inflation-adjusted based on concordance with observer reports. Results showed that community therapists surpassed the fidelity benchmark for core family therapy techniques established by research therapists during a controlled trial. Regarding change in client functioning at 6-month follow-up, community therapists were equivalent to the benchmark for internalizing symptoms and superior for externalizing symptoms and delinquent acts. Community therapists also demonstrated a high degree of performance uniformity: Each one approximated the fidelity benchmark, and only two produced relatively weak outcomes on any of the client change indicators. Caveats for interpreting therapist performance data, given the small sample size, are described. Recommendations are made for developing therapist-report fidelity measures and utilizing statistical process control methods to diagnose therapist differences and enhance quality assurance procedures.
The National Center on Addiction and Substance Abuse, 633 Third Avenue, 19th floor, New York, NY, 10017, USA. ahogue@centeronaddiction.org.
Aaron
A
Hogue
The National Center on Addiction and Substance Abuse, 633 Third Avenue, 19th floor, New York, NY, 10017, USA.
Sarah
S
Dauber
Department of Psychology, Sam Houston State University, Huntsville, USA.
Craig E
CE
Henderson
D000293:Adolescent; D000294:Adolescent Behavior; D019985:Benchmarking / Q000592:standards*; D003156:Community Mental Health Services / Q000458:organization & administration* / Q000592:standards; D005196:Family Therapy / Q000458:organization & administration* / Q000592:standards; D005260:Female; D019983:Guideline Adherence; D006801:Humans; D008297:Male; D001523:Mental Disorders / Q000628:therapy*; D017410:Practice Guidelines as Topic; D011787:Quality of Health Care / Q000458:organization & administration; D044469:Racial Groups
Adolescent behavior problems; Benchmarking; Family therapy; Fidelity; Outcomes; Therapist; Usual care
Adm Policy Ment Health. 2014 Jan;41(1):126-39
23124275
Am Psychol. 2010 Feb-Mar;65(2):73-84
20141263
Psychol Assess. 2016 Jan;28(1):70-80
26011477
Psychotherapy (Chic). 2012 Jun;49(2):152-62
21967075
J Am Acad Child Adolesc Psychiatry. 2007 May;46(5):647-52
17450056
Adm Policy Ment Health. 2014 Sep;41(5):697-705
24068479
J Fam Psychol. 2009 Apr;23(2):119-29
19364207
Adm Policy Ment Health. 2010 May;37(3):230-44
19902347
Adm Policy Ment Health. 2017 May;44(3):380-394
26884380
Psychol Methods. 2009 Jun;14(2):81-100
19485623
J Consult Clin Psychol. 1991 Feb;59(1):20-6
2002139
Interact Cardiovasc Thorac Surg. 2009 Sep;9(3):494-9
19509097
J Clin Child Adolesc Psychol. 2005 Dec;34(4):658-70
16232063
J Marital Fam Ther. 2012 Jan;38(1):30-58
22283380
J Consult Clin Psychol. 1992 Feb;60(1):73-9
1556289
J Marital Fam Ther. 2012 Jan;38(1):281-304
22283391
J Am Acad Child Adolesc Psychiatry. 2005 Oct;44(10):1058-62
16175111
Fam Process. 2000 Spring;39(1):83-103
10742933
Clin Psychol (New York). 2010 Mar;17(1):1-30
20877441
J Ment Health Adm. 1994 Spring;21(2):201-9
10145995
Psychother Res. 2009 Mar;19(2):181-93
19396649
Adm Policy Ment Health. 2013 Jan;40(1):6-22
23212902
J Couns Psychol. 2013 Jan;60(1):31-41
23356465
J Consult Clin Psychol. 2002 Apr;70(2):299-310
11952188
J Clin Child Adolesc Psychol. 2014;43(5):695-720
24926870
Eval Program Plann. 2013 Apr;37:21-30
23314000
J Clin Psychiatry. 1998;59 Suppl 20:22-33;quiz 34-57
9881538
J Fam Psychol. 2006 Dec;20(4):535-43
17176187
J Behav Health Serv Res. 2010 Jan;37(1):40-63
18690540
Clin Psychol (New York). 2011 Jun;18(2):142-147
21691439
Adm Policy Ment Health. 2010 Mar;37(1-2):15-26
20177769
Ment Health Serv Res. 1999 Sep;1(3):171-84
11258740
Adm Policy Ment Health. 2015 Mar;42(2):229-43
24711046
J Consult Clin Psychol. 2011 Jun;79(3):267-78
21639607
J Child Psychol Psychiatry. 2005 Jul;46(7):690-713
15972066
J Consult Clin Psychol. 2008 Feb;76(1):116-24
18229989
Adm Policy Ment Health. 2013 Nov;40(6):518-29
23525895
Arch Gen Psychiatry. 2012 Mar;69(3):274-82
22065252
J Clin Child Adolesc Psychol. 2014;43(2):301-11
24245958
J Am Acad Child Adolesc Psychiatry. 2008 May;47(5):505-14
18356768
J Clin Child Adolesc Psychol. 2015 ;44(6):954-69
25496283
Adm Policy Ment Health. 2008 Sep;35(5):379-94
18561019
J Fam Ther. 2009 May 1;31(2):126-154
21113237
J Fam Psychol. 2008 Jun;22(3):439-47
18540772
Psychol Methods. 2000 Dec;5(4):425-33
11194206
Drug Alcohol Depend. 2000 Jan 1;57(3):225-38
10661673
Eval Program Plann. 1999 May;22(2):199-210
24011413
J Subst Abuse Treat. 2013 Feb;44(2):145-58
22763198
J Clin Child Adolesc Psychol. 2002 Jun;31(2):168-80
12056101
Behav Res Ther. 2012 Jun;50(6):393-6
22504122
J Consult Clin Psychol. 1996 Dec;64(6):1276-84
8991314
J Clin Child Adolesc Psychol. 2014;43(4):643-55
24661234
J Subst Abuse Treat. 2008 Sep;35(2):137-47
17997268
Adm Policy Ment Health. 2008 Mar;35(1-2):114-23
17987376
J Clin Child Adolesc Psychol. 2009 Jan;38(1):91-105
19130360
Behav Cogn Psychother. 2014 Jan;42(1):16-30
23092729
Clin Psychol (New York). 2013 Mar;20(1):14-32
23935254