title: Inter-expert agreement of seven criteria in causality assessment of adverse drug reactions.
abstract: OBJECTIVE
  To evaluate agreement between five senior experts when assessing seven causality criteria and the probability of drug causation.
  
  
  METHODS
  A sample of 31 adverse event-drug pairs was constituted. For each pair, five experts separately assessed (i) the probability of drug causation, which was secondarily divided into seven causality levels: ruled out (0-0.05), unlikely (0.06-0.25), doubtful (0.26-0.45), indeterminate (0.46-0.55), plausible (0.56-0.75), likely (0.76-0.95), and certain (0.96-1); and (ii) seven causality criteria. To test discrepancies between experts, the kappa index was used.
  
  
  RESULTS
  The agreement of the five experts was very poor (kappa = 0.05) for the probability of drug causation. Among the seven levels of causality, only 'doubtful' showed a significant rate of agreement (kappa = 0.32, P < 0.001). For all criteria, the kappa index was significant except for the item 'risk(s) factor(s)' (kappa = 0.09). Agreement between experts was good (0.64, P < 0.001) only for the criterion 'reaction at site of application or toxic plasma concentration of the drug or validated test'. However, the rate of agreement with kappa indices of the causality criteria ranged from 0.12 to 0.38.
  
  
  CONCLUSIONS
  This study confirms that in the absence of an operational procedure, agreement between experts is low. This should be considered when designing a causality assessment method. In particular, criteria inducing a low level of agreement should have their weight reduced.
authors: INSERM U 657, Département de Pharmacologie, Université Victor Segalen, Bordeaux 2, France. yannick.arimone@etud.u-bordeaux2.fr
authors: Yannick
authors: Y
authors: Arimone
authors: Ghada
authors: G
authors: Miremont-Salamé
authors: Françoise
authors: F
authors: Haramburu
authors: Mathieu
authors: M
authors: Molimard
authors: Nicholas
authors: N
authors: Moore
authors: Annie
authors: A
authors: Fourrier-Réglat
authors: Bernard
authors: B
authors: Bégaud
mesh_terms: D016907:Adverse Drug Reaction Reporting Systems; D015984:Causality; D064420:Drug-Related Side Effects and Adverse Reactions; D006801:Humans; D015588:Observer Variation; D011336:Probability
references: Clin Pharmacol Ther. 1981 Aug;30(2):239-45
references: 7249508
references: Eur J Clin Pharmacol. 1977 Jan 3;11(2):75-8
references: 837969
references: Clin Pharmacol Ther. 1974 Nov;16(5 Part 1):846-57
references: 4426153
references: J Clin Pharm Ther. 2003 Apr;28(2):137-43
references: 12713611
references: Clin Pharmacol Ther. 1976 May;19(5 Pt 1):489-92
references: 1277705
references: Clin Pharmacol Ther. 1995 Dec;58(6):692-8
references: 8529335
references: Pharmacoepidemiol Drug Saf. 1998 Aug;7 Suppl 1:S63-5
references: 15073963
references: Clin Pharmacol Ther. 1983 Oct;34(4):421-6
references: 6617062
references: Br J Clin Pharmacol. 1981;11 Suppl 1:105S-110S
references: 7052788
references: Int J Clin Pharmacol Ther Toxicol. 1980 Sep;18(9):381-8
references: 7450930
references: BMJ. 2000 Apr 15;320(7241):1036
references: 10764362
references: Clin Pharmacol Ther. 1986 Oct;40(4):451-61
references: 3757408
references: J Clin Epidemiol. 1989;42(1):5-16
references: 2913186
references: Clin Pharmacol Ther. 1979 May;25(5 Pt 1):493-8
references: 436353
references: Eur J Clin Pharmacol. 1994;46(4):285-9
references: 7957509
references: JAMA. 1979 Nov 2;242(18):1991-4
references: 480646
references: Drug Saf. 1997 Dec;17(6):374-89
references: 9429837
references: Pharmacoepidemiol Drug Saf. 2005 Dec;14(12):885-90
references: 16059869
references: Adverse Drug React Acute Poisoning Rev. 1987 Spring;6(1):1-35
references: 3303863
references: Eur J Clin Pharmacol. 2005 May;61(3):169-73
references: 15827761