Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews.
Standardized diagnostic interviews (SDIs) have become de facto gold standards for clinical research. However, because clinical practitioners seldom use SDIs, it is essential to determine how well SDIs agree with clinical diagnoses. In meta-analyses of 38 articles published from 1995 to 2006 (N = 15,967 probands), mean kappas (z-transformed) between diagnoses from clinical evaluations versus SDIs were 0.27 for a broad category of all disorders, 0.29 for externalizing disorders, and 0.28 for internalizing disorders. Kappas for specific disorders ranged from 0.19 for generalized anxiety disorder to 0.86 for anorexia nervosa (median = 0.48). For diagnostic clusters (e.g. psychotic disorders), kappas ranged from 0.14 for affective disorders (including bipolar) to 0.70 for eating disorders (median = 0.43). Kappas were significantly higher for outpatients than inpatients and for children than adults. However, these effects were not significant in meta-regressions.


CONCLUSIONS
Diagnostic agreement between SDIs and clinical evaluations varied widely by disorder and was low to moderate for most disorders. Thus, findings from SDIs may not fully apply to diagnoses based on clinical evaluations of the sort used in the published studies. Rather than implying that SDIs or clinical evaluations are inferior, characteristics of both may limit agreement and generalizability from SDI findings to clinical practice.
Rettew
David C
DC
Department of Psychiatry, University of Vermont College of Medicine, Burlington, VT 05401, USA. david.rettew@uvm.edu
Lynch
Alicia Doyle
AD
Achenbach
Thomas M
TM
Dumenci
Levent
L
Ivanova
Masha Y
MY
D000293:Adolescent; D002648:Child; D002675:Child, Preschool; D005260:Female; D006801:Humans; D007406:Interview, Psychological; D008297:Male; D011569:Psychiatric Status Rating Scales; D011618:Psychotic Disorders / Q000145:classification / Q000175:diagnosis*; D012016:Reference Values; D012043:Regression, Psychology; D015203:Reproducibility of Results; D012189:Retrospective Studies; D055815:Young Adult
J Am Acad Child Adolesc Psychiatry. 2000 Jan;39(1):28-38
10638065
Am J Psychiatry. 2000 Oct;157(10):1599-605
11007713
Psychol Med. 2004 Aug;34(6):1013-24
15554572
J Nerv Ment Dis. 1994 May;182(5):277-83
10678309
J Child Psychol Psychiatry. 2000 Jul;41(5):645-55
10946756
J Am Acad Child Adolesc Psychiatry. 1987 Sep;26(5):621-30
3312159
BMC Psychiatry. 2006 Mar 15;6:10
16539703
J Am Acad Child Adolesc Psychiatry. 1997 Jul;36(7):980-8
9204677
J Am Acad Child Adolesc Psychiatry. 2003 Mar;42(3):349-56
12595789
J Psychiatr Res. 1994 Jan-Feb;28(1):57-84
8064641
J Clin Psychiatry. 1998;59 Suppl 20:22-33;quiz 34-57
9881538
JAMA. 1997 Sep 17;278(11):905-10
9302242
Br J Gen Pract. 2000 Apr;50(453):284-7
10897511
Arch Gen Psychiatry. 1985 Jul;42(7):657-66
4015307
J Abnorm Psychol. 2005 Nov;114(4):537-50
16351376
Braz J Psychiatry. 2005 Mar;27(1):25-31
15867980
J Am Acad Child Adolesc Psychiatry. 1987 Sep;26(5):649-53
3667494
J Psychiatr Res. 2000 May-Jun;34(3):211-20
10867116
Yonsei Med J. 2004 Feb 29;45(1):81-9
15004873
J Clin Child Adolesc Psychol. 2004 Sep;33(3):536-46
15271611
J Psychiatr Res. 1997 Sep-Oct;31(5):581-92
9368199
Aust N Z J Psychiatry. 2001 Apr;35(2):224-30
11284905
J Consult Clin Psychol. 2002 Feb;70(1):158-68
11860042
East Mediterr Health J. 2006;12 Suppl 2:S138-46
17361685
Psychol Methods. 2001 Jun;6(2):161-80
11411440
J Am Acad Child Adolesc Psychiatry. 2000 Jan;39(1):59-66
10638068
Arch Gen Psychiatry. 1998 Feb;55(2):109-15
9477922
J Pers Disord. 2003 Dec;17(6):550-61
14744080
J Am Acad Child Adolesc Psychiatry. 2000 Jan;39(1):19-27
10638064
J Am Acad Child Adolesc Psychiatry. 1987 Sep;26(5):613-20
3312158
J Appl Psychol. 2002 Jun;87(3):583-9
12090616
J Child Psychol Psychiatry. 1997 May;38(4):431-40
9232488
Community Ment Health J. 1997 Dec;33(6):531-43
9435999
Psychol Med. 1999 Sep;29(5):1013-20
10576294
J Am Acad Child Adolesc Psychiatry. 2003 Nov;42(11):1318-26
14566169
Am J Psychiatry. 2000 Apr;157(4):581-7
10739417
Stat Med. 1995 Oct 30;14(20):2285-8
8552905
Can J Psychiatry. 1997 Nov;42(9):966-73
9429068
Arch Gen Psychiatry. 1992 Aug;49(8):624-9
1637252
Gen Hosp Psychiatry. 1999 Mar-Apr;21(2):87-96
10228888
Psychiatry Clin Neurosci. 2005 Oct;59(5):517-26
16194252
J Clin Psychiatry. 1997 Oct;58(10):457-63; quiz 464-5
9375599
Gen Hosp Psychiatry. 2002 Jan-Feb;24(1):4-11
11814528
Psychol Med. 1999 Sep;29(5):1021-7
10576295
Eur Psychiatry. 2005 Mar;20(2):193-5
15797707
Scand J Prim Health Care. 1996 Sep;14(3):142-7
8885025
Arch Phys Med Rehabil. 2004 Jul;85(7):1192-7
15241773
J Am Acad Child Adolesc Psychiatry. 1987 Sep;26(5):662-7
3667496
Arch Gen Psychiatry. 1992 Aug;49(8):630-6
1637253
Compr Psychiatry. 1983 Sep-Oct;24(5):399-411
6354575
Psychol Med. 2001 Aug;31(6):1001-13
11513368
J Affect Disord. 1999 Nov;56(1):37-48
10626778
J Am Acad Child Adolesc Psychiatry. 1989 Jan;28(1):53-60
2914836
Arch Gen Psychiatry. 1982 Aug;39(8):879-83
7103676
Int J Psychiatry Clin Pract. 2004;8(2):77-84
24926839
J Affect Disord. 2004 Feb;78(2):131-40
14706723
Arch Fam Med. 1998 Sep-Oct;7(5):451-61
9755738
Arch Gen Psychiatry. 1985 Jul;42(7):667-75
4015308
Isr J Psychiatry Relat Sci. 1997;34(3):179-86
9334522
Int J Eat Disord. 1998 Apr;23(3):341-5
9547668
J Nerv Ment Dis. 1995 Jun;183(6):365-9
7798084
Psychosomatics. 2003 Sep-Oct;44(5):402-6
12954914
Biometrics. 1977 Mar;33(1):159-74
843571
Compr Psychiatry. 2004 May-Jun;45(3):213-8
15124152
Eur Psychiatry. 1998 Jul;13(4):198-202
19698625
Soc Psychiatry Psychiatr Epidemiol. 2005 Aug;40(8):663-71
16091858
Psychiatr Serv. 1997 Jun;48(6):815-20
9175192
Psychol Bull. 2005 May;131(3):361-82
15869333
Am J Psychiatry. 1996 May;153(5):636-44
8615408
Arch Gen Psychiatry. 1981 Apr;38(4):381-9
6260053
Res Synth Methods. 2011 Sep;2(3):221-2
26061787
Arch Gen Psychiatry. 1978 Jul;35(7):837-44
678037
Arch Fam Med. 2000 Sep-Oct;9(9):814-21
11031387
Psychol Med. 1995 Jul;25(4):739-53
7480451