title: Clinical validation of the AHRQ postoperative venous thromboembolism patient safety indicator.
abstract: BACKGROUND
  The Agency for Healthcare Research and Quality (AHRQ) patient safety indicators (PSIs) screen for potentially preventable complications in hospitalized patients using hospital administrative data. The PSI for postoperative venous thromboembolism (VTE) relies on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes for deep vein thrombosis (DVT) or pulmonary embolism (PE) in secondary diagnoses fields. In a clinical validation study of the PSI for postoperative VTE, natural language processing (NLP), supplemented by pharmacy and billing data, was used to identify VTE events missed by medical records coders.
  
  
  METHODS
  In a retrospective review of postsurgical discharges, charts were processed using the AHRQ PSI software. Cases were identified as possible false negatives by flagging charts for possible VTEs using pharmacy and billing data to identify all patients who were therapeutically anticoagulated or had placement of an inferior vena caval filter. All charts were reviewed by a physician blinded to screening results. Physician interpretation was considered the gold standard for VTE classification.
  
  
  RESULTS
  The AHRQ PSI had a positive predictive value (PPV) of .545 (95% confidence interval [CI], .453-.634) and a negative predictive value (NPV) of .997 (95% CI, .995-.999). Sensitivity was .87 and specificity was .98. Secondary coding review suggested that all 9 false-negative results were miscoded; if they had been properly coded, the sensitivity would increase to 1.00. Most false-positive cases resulted from superficial venous clots identified by the PSI due to coding ambiguity.
  
  
  CONCLUSIONS
  The VTE PSI performed well as a screening tool but generated a significant number of false-positive cases, a problem that could be substantially reduced with improved coding methods.
authors.affiliation: Department of Medicine, Washington University School of Medicine, St. Louis, USA. KHenders@DOM.wustl.edu
authors.forename: Katherine E
authors.initials: KE
authors.lastname: Henderson
authors.forename: Angela j
authors.initials: Aj
authors.lastname: Recktenwald
authors.forename: Richard M
authors.initials: RM
authors.lastname: Reichley
authors.forename: Thomas C
authors.initials: TC
authors.lastname: Bailey
authors.forename: Brian M
authors.initials: BM
authors.lastname: Waterman
authors.forename: Rebecca L
authors.initials: RL
authors.lastname: Diekemper
authors.forename: Patricia E
authors.initials: PE
authors.lastname: Storey
authors.forename: Belinda K
authors.initials: BK
authors.lastname: Ireland
authors.forename: Wm Claiborne
authors.initials: WC
authors.lastname: Dunagan
mesh_terms: D000465:Algorithms; D006801:Humans; D009323:Natural Language Processing; D011182:Postoperative Care; D011237:Predictive Value of Tests; D019984:Quality Indicators, Health Care; D015203:Reproducibility of Results; D012189:Retrospective Studies; D012308:Risk Management / Q000706:statistics & numerical data*; D012680:Sensitivity and Specificity; D016037:Single-Blind Method; D014481:United States; D016270:United States Agency for Healthcare Research and Quality / Q000706:statistics & numerical data; D054556:Venous Thromboembolism / Q000517:prevention & control*