title: Pre- and post-training session evaluation for interobserver agreement and diagnostic accuracy of probe-based confocal laser endomicroscopy for biliary strictures.
abstract: OBJECTIVE
  Current diagnostic modalities for indeterminate biliary strictures offer low accuracy. Probe-based confocal laser endomicroscopy (pCLE) permits microscopic assessment of mucosal structures by obtaining real-time high-resolution images of the mucosal layers of the gastrointestinal tract. Previously, an interobserver study demonstrated poor to fair agreement even among experienced confocal endomicroscopy operators. Our objective was to assess interobserver agreement and diagnostic accuracy upon completion of a pCLE training session.
  
  
  METHODS
  Forty de-identified pCLE video clips of indeterminate biliary strictures were sent to five endoscopists at four tertiary care centers for scoring. Observers subsequently attended a teaching session by an expert pCLE user that included 20 training clips and rescored the same pCLE video clips, which were randomized and renumbered.
  
  
  RESULTS
  Pre-training interobserver agreement for all observers was 'fair' (Κ: 0.31, P-value: <0.0001) and diagnostic accuracy was 72% (55-80%). Post-training interobserver agreement for all observers was 'substantial' (Κ: 0.74, P-value: <0.0001) and diagnostic accuracy was 89% (80-95%). Using a paired t-test, we observed an increase of 17% (95% CI 7.6-26.4) in post-training diagnostic accuracy (t = 5.01, df = 4, P-value 0.007).
  
  
  CONCLUSIONS
  Interobserver agreement and diagnostic accuracy improved after observers underwent training by an expert pCLE user with a specific sequence set. Users should participate in such training programs to maximize diagnostic accuracy of pCLE evaluation.
authors.affiliation: Department of Gastroenterology, University of Virginia, Charlottesville, USA.
authors.forename: Jayant P
authors.initials: JP
authors.lastname: Talreja
authors.forename: Brian G
authors.initials: BG
authors.lastname: Turner
authors.forename: Frank G
authors.initials: FG
authors.lastname: Gress
authors.forename: Sammy
authors.initials: S
authors.lastname: Ho
authors.forename: Savreet
authors.initials: S
authors.lastname: Sarkaria
authors.forename: Naveen
authors.initials: N
authors.lastname: Paddu
authors.forename: Nikola
authors.initials: N
authors.lastname: Natov
authors.forename: Sheila
authors.initials: S
authors.lastname: Bharmal
authors.forename: Monica
authors.initials: M
authors.lastname: Gaidhane
authors.forename: Amrita
authors.initials: A
authors.lastname: Sethi
authors.forename: Michel
authors.initials: M
authors.lastname: Kahaleh
mesh_terms: D002779:Cholestasis / Q000473:pathology / Q000628:therapy*; D002983:Clinical Competence; D016099:Endoscopy, Gastrointestinal / Q000193:education* / Q000379:methods*; D006801:Humans; D018613:Microscopy, Confocal / Q000379:methods*; D015588:Observer Variation; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D014741:Video Recording
keywords: Miami classification; biliary stricture; confocal endomicroscopy; interobserver agreement; probe-based confocal laser endomicroscopy (pCLE)