title: Interrater Reliability and Diagnostic Performance of Subjective Evaluation of Sublingual Microcirculation Images by Physicians and Nurses: A Multicenter Observational Study.
abstract: BACKGROUND
  This was a cross-sectional multicenter study to investigate the ability of physicians and nurses from three different countries to subjectively evaluate sublingual microcirculation images and thereby discriminate normal from abnormal sublingual microcirculation based on flow and density abnormalities.
  
  
  METHODS
  Forty-five physicians and 61 nurses (mean age, 36 ± 10 years; 44 males) from three different centers in The Netherlands (n = 61), Uruguay (n = 12), and Japan (n = 33) were asked to subjectively evaluate a sample of 15 microcirculation videos randomly selected from an experimental model of endotoxic shock in pigs. All videos were first analyzed offline using the A.V.A. software by an independent, experienced investigator and were categorized as good, bad, or very bad microcirculation based on the microvascular flow index, perfused capillary density, and proportion of perfused capillaries. Then, the videos were randomly assigned to the examiners, who were instructed to subjectively categorize each image as good, bad, or very bad. An interrater analysis was performed, and sensitivity and specificity tests were calculated to evaluate the proportion of A.V.A. score abnormalities that the examiners correctly identified.
  
  
  RESULTS
  The κ statistics indicated moderate agreement in the evaluation of microcirculation abnormalities using three categories, i.e., good, bad, or very bad (κ = 0.48), and substantial agreement using two categories, i.e., normal (good) and abnormal (bad or very bad) (κ = 0.66). There was no significant difference between the κ three and κ two statistics. We found that the examiner's subjective evaluations had good diagnostic performance and were highly sensitive (84%; 95% confidence interval, 81%-86%) and specific (87%; 95% confidence interval, 84%-90%) for sublingual microcirculatory abnormalities as assessed using the A.V.A. software.
  
  
  CONCLUSIONS
  The subjective evaluations of sublingual microcirculation by physicians and nurses agreed well with a conventional offline analysis and were highly sensitive and specific for sublingual microcirculatory abnormalities.
authors.affiliation: *Department of Intensive Care, Erasmus MC, University Hospital Rotterdam, Rotterdam, The Netherlands; †Pathophysiology Department, University Hospital, School of Medicine, Universidad de la República, Montevideo, Uruguay; and ‡Department of Anesthesiology, Shimane University Faculty of Medicine, Shimane, Japan.
authors.forename: Alexandre
authors.initials: A
authors.lastname: Lima
authors.forename: Alejandra
authors.initials: A
authors.lastname: López
authors.forename: Michel E
authors.initials: ME
authors.lastname: van Genderen
authors.forename: Francisco Javier
authors.initials: FJ
authors.lastname: Hurtado
authors.forename: Martin
authors.initials: M
authors.lastname: Angulo
authors.forename: Juan C
authors.initials: JC
authors.lastname: Grignola
authors.forename: Atsuko
authors.initials: A
authors.lastname: Shono
authors.forename: Jasper
authors.initials: J
authors.lastname: van Bommel
mesh_terms: D000328:Adult; D000818:Animals; D002196:Capillaries / Q000473:pathology; D003430:Cross-Sectional Studies; D005260:Female; D006801:Humans; D008297:Male; D008505:Medical Staff, Hospital / Q000592:standards; D008833:Microcirculation / Q000502:physiology; D018715:Microscopy, Video; D008875:Middle Aged; D009060:Mouth Floor / Q000098:blood supply*; D009741:Nursing Staff, Hospital / Q000592:standards; D015588:Observer Variation; D019095:Point-of-Care Systems; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012772:Shock, Septic / Q000175:diagnosis* / Q000503:physiopathology; D034421:Sus scrofa