Reliability of the Roussel Uclaf Causality Assessment Method for assessing causality in drug-induced liver injury.
The Roussel Uclaf Causality Assessment Method (RUCAM) was developed to quantify the strength of association between a liver injury and the medication implicated as causing the injury. However, its reliability in a research setting has never been fully explored. The aim of this study was to determine test-retest and interrater reliabilities of RUCAM in retrospectively-identified cases of drug induced liver injury. The Drug-Induced Liver Injury Network is enrolling well-defined cases of hepatotoxicity caused by isoniazid, phenytoin, clavulanate/amoxicillin, or valproate occurring since 1994. Each case was adjudicated by three reviewers working independently; after an interval of at least 5 months, cases were readjudicated by the same reviewers. A total of 40 drug-induced liver injury cases were enrolled including individuals treated with isoniazid (nine), phenytoin (five), clavulanate/amoxicillin (15), and valproate (11). Mean +/- standard deviation age at protocol-defined onset was 44.8 +/- 19.5 years; patients were 68% female and 78% Caucasian. Cases were classified as hepatocellular (44%), mixed (28%), or cholestatic (28%). Test-retest differences ranged from -7 to +8 with complete agreement in only 26% of cases. On average, the maximum absolute difference among the three reviewers was 3.1 on the first adjudication and 2.7 on the second, although much of this variability could be attributed to differences between the enrolling investigator and the external reviewers. The test-retest reliability by the same assessors was 0.54 (upper 95% confidence limit = 0.77); the interrater reliability was 0.45 (upper 95% confidence limit = 0.58). Categorizing the RUCAM to a five-category scale improved these reliabilities but only marginally.


CONCLUSIONS
The mediocre reliability of the RUCAM is problematic for future studies of drug-induced liver injury. Alternative methods, including modifying the RUCAM, developing drug-specific instruments, or causality assessment based on expert opinion, may be more appropriate.
Rochon
James
J
Duke Clinical Research Institute, Durham, NC 27713, USA. james.rochon@duke.edu
Protiva
Petr
P
Seeff
Leonard B
LB
Fontana
Robert J
RJ
Liangpunsakul
Suthat
S
Watkins
Paul B
PB
Davern
Timothy
T
McHutchison
John G
JG
D000293:Adolescent; D000328:Adult; D000368:Aged; D015984:Causality; D002648:Child; D002675:Child, Preschool; D064420:Drug-Related Side Effects and Adverse Reactions; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D015203:Reproducibility of Results; D012128:Respiratory Distress Syndrome / Q000139:chemically induced* / Q000453:epidemiology*; D012189:Retrospective Studies; D018570:Risk Assessment / Q000379:methods*; D012720:Severity of Illness Index
Lancet. 1986 Feb 8;1(8476):307-10
2868172
Hepatology. 2001 Jan;33(1):308-10
11124850
J Clin Epidemiol. 1993 Nov;46(11):1323-30
8229110
Hepatology. 2004 Oct;40(4):773
15382161
J Clin Gastroenterol. 2006 Aug;40(7):629-32
16917407
Drug Saf. 2007;30(4):277-94
17408305
Hepatology. 2006 Dec;44(6):1581-8
17133470
Stat Med. 1987 Jun;6(4):441-8
3629046
J Clin Epidemiol. 1993 Nov;46(11):1331-6
8229111
Drug Saf. 2005;28(4):351-70
15783243
J Clin Epidemiol. 2000 Mar 1;53(3):297-306
10760641
Phys Ther. 1994 Aug;74(8):777-88
8047565
Gastroenterology. 2007 Aug;133(2):423-32
17681163
Hepatology. 2001 Jan;33(1):123-30
11124828
Toxicol Pathol. 2005;33(1):155-64
15805067
Clin Toxicol (Phila). 2007;45(1):51-5
17357382
Rheumatology (Oxford). 2004 Jan;43(1):49-54
12867580
Hepatology. 1997 Sep;26(3):664-9
9303497
Arthritis Rheum. 2004 May;50(5):1595-603
15146430
Dig Dis Sci. 2005 Oct;50(10):1785-90
16187174
Hepatol Res. 2003 Jan;25(1):1-7
12644032
Aliment Pharmacol Ther. 2007 Jul 1;26(1):79-85
17555424
Stat Med. 2000 May 15;19(9):1141-64
10797513
Clin Trials. 2004;1(6):553-66
16279296
Hepatology. 2006 Mar;43(3):618-31
16496329
Can J Gastroenterol. 2006 May;20(5):351-5
16691302
Hepatology. 2004 Jun;39(6):1603-12
15185301
J Cardiopulm Rehabil. 2006 Nov-Dec;26(6):395-404
17135861
Liver Transpl. 2006 Jun;12(6):989-92
16721764
N Engl J Med. 2006 Feb 16;354(7):731-9
16481640
Clin Exp Rheumatol. 2005 Sep-Oct;23(5 Suppl 39):S31-42
16273783
J Clin Psychol. 1990 Nov;46(6):928-30
2286694