title: Comparison of the diagnostic utility of physician-diagnosed with algorithm-defined stroke-associated pneumonia.
abstract: OBJECTIVE
  Diagnosing stroke-associated pneumonia (SAP) is challenging and may result in inappropriate antibiotic use or confound research outcomes. This study evaluates the diagnostic accuracy of algorithm-defined versus physician-diagnosed SAP in 1088 patients who had dysphagic acute stroke from 37 UK stroke units between 21 April 2008 and 17 May 2014.
  
  
  METHODS
  SAP in the first 14 days was diagnosed by a criteria-based algorithm applied to blinded patient data and independently by treating physicians. Patients in whom diagnoses differed were reassigned following blinded adjudication of individual patient records. The sensitivity, specificity, positive predictive value (PPV) and diagnostic OR of algorithmic and physician diagnosis of SAP were assessed using adjudicated SAP as the reference standard. Agreement was assessed using the κ statistic.
  
  
  RESULTS
  Physicians diagnosed SAP in 176/1088 (16%) and the algorithm in 123/1088 (11.3%) patients. Diagnosis agreed in 885/1088 (81.3%) patients (κ 0.22 (95% CI 0.14 to 0.29)). On a blinded review, 129/1088 (11.8%) patients were adjudicated as patients with SAP. The algorithm and the physicians had high specificity (97% (95% CI 96% to 98%) and 90% (95% CI 88% to 92%), respectively) but only moderate sensitivity (72% (95% CI 64% to 80%) and 65% (95% CI 56% to 73%), respectively) in diagnosing SAP. The algorithm showed better PPV (76% (95% CI 67% to 83%) vs 48% (95% CI 40% to 55%)), diagnostic OR (80 (95% CI 42 to 136) vs 18 (95% CI 12 to 27)) and agreement (κ 0.70 (95% CI 0.63 to 0.78) vs 0.48 (95% CI 0.41 to 0.54)) than physician diagnosis with adjudicated SAP.
  
  
  CONCLUSIONS
  Algorithm-based approaches can standardise SAP diagnosis for clinical practice and research.
  
  
  BACKGROUND
  ISRCTN37118456; Post-results.
authors.affiliation: Department of Basic and Clinical Neurosciences, Institute of Psychiatry, Psychology and Neurosciences, King's College London, London, UK.
authors.forename: Lalit
authors.initials: L
authors.lastname: Kalra
authors.affiliation: Biostatistics Department, NIHR Biomedical Research Centre for Mental Health and Institute of Psychiatry, Psychology and Neurosciences, King's College London, London, UK.
authors.forename: John
authors.initials: J
authors.lastname: Hodsoll
authors.affiliation: Department of Basic and Clinical Neurosciences, Institute of Psychiatry, Psychology and Neurosciences, King's College London, London, UK.
authors.forename: Saddif
authors.initials: S
authors.lastname: Irshad
authors.affiliation: University of Kent, Canterbury, UK.
authors.forename: David
authors.initials: D
authors.lastname: Smithard
authors.affiliation: King's College Hospital NHS Foundation Trust, London, UK.
authors.forename: Dulka
authors.initials: D
authors.lastname: Manawadu
mesh_terms: D000368:Aged; D000369:Aged, 80 and over; D000465:Algorithms; D003680:Deglutition Disorders / Q000209:etiology; D003936:Diagnosis, Computer-Assisted; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D010820:Physicians; D011014:Pneumonia / Q000175:diagnosis*; D011446:Prospective Studies; D012680:Sensitivity and Specificity; D012984:Software; D020521:Stroke / Q000175:diagnosis*