title: A new approach to reliability assessment of dental caries examinations.
abstract: OBJECTIVE
  The objective of this study is to evaluate reliability of the International Caries Detection and Assessment System (ICDAS) and identify sources of disagreement among eight Kuwaiti dentists with no prior knowledge of the system.
  
  
  METHODS
  A 90-min introductory e-course was introduced followed by an examination of extracted teeth using the ICDAS coding system on the first day. Then three sessions of clinical examinations were performed. This study only used the data from the last session where 705 tooth surfaces of 10 patients were examined to assess bias in caries examination and on which codes the examiners had the highest disagreement. Compared with the gold standard, we evaluated bias of the ICDAS coding using three approaches (Bland-Altman plot, maximum kappa statistic, and Bhapkar's chi-square test). Linear weighted kappa statistics were computed to assess interexaminer reliability.
  
  
  RESULTS
  Marginal ICDAS distributions for most examiners were significantly different from that of the gold standard (bias present). The primary source of these marginal differences was misclassifying sound surfaces as noncavitated lesions. Interexaminer reliability of the 3-level ICDAS (codes 0, 1-2, and 3-6) classification ranged between 0.43 and 0.73, indicating evidence of substantial inconsistency between examiners. The primary source of examiner differences was agreeing on diagnosing noncavitated lesions.
  
  
  CONCLUSIONS
  This study highlights the importance of assessing both systematic and random sources of examiner agreement to correctly interpret kappa measures of reliability.
authors.affiliation: Faculty of Dentistry, Kuwait University, Kuwait City, Kuwait. yacoub@hsc.edu.kw
authors.forename: Yacoub
authors.initials: Y
authors.lastname: Altarakemah
authors.forename: Mona
authors.initials: M
authors.lastname: Al-Sane
authors.forename: Sungwoo
authors.initials: S
authors.lastname: Lim
authors.forename: Albert
authors.initials: A
authors.lastname: Kingman
authors.forename: Amid I
authors.initials: AI
authors.lastname: Ismail
mesh_terms: D003731:Dental Caries / Q000145:classification / Q000175:diagnosis*; D006801:Humans; D015588:Observer Variation; D015203:Reproducibility of Results; D013223:Statistics as Topic
keywords: agreement; caries; epidemiology; reliability