title: Validity of the AHRQ Patient Safety Indicator "central venous catheter-related bloodstream infections".
abstract: BACKGROUND
  "Central venous catheter-related bloodstream infections" (CR-BSIs) is one of the patient safety indicators (PSI 7) developed by the Agency for Healthcare Research and Quality (AHRQ) to screen for potential safety events. We sought to investigate the validity of this PSI using the medical record as the gold standard.
  
  
  METHODS
  We conducted a retrospective cross-sectional study of all hospitalization records that met the criteria for PSI 7 within Veterans Health Administration (VA) hospitals from fiscal years 2003 to 2007. Trained abstractors used a standardized abstraction tool to review electronic medical records for the presence of a CR-BSI and the clinical circumstances surrounding the event. We determined the validity of this PSI by calculating its positive predictive value (PPV), and analyzed both true and false positive cases.
  
  
  RESULTS
  Of 112 reviewed cases, 42 were true events of CR-BSIs, yielding a PPV of 38% (95% CI 29% to 47%). Seventy cases were false positives; these were attributed to correct ICD-9-CM codes but had diagnoses that fell outside the scope of the indicator (n = 28, 40%), coding inaccuracies (n = 21, 30%); and present on admission (POA) diagnoses (n = 21; 30%). Among the 42 patients with CR-BSIs, catheters were left in place for an average of 11 days, and 20% (n = 8) were placed in the femoral position.
  
  
  CONCLUSIONS
  PSI 7 has relatively poor predictive ability for identifying true events. Coding-related issues were the main reason for the low PPV. Implementing POA codes and using more specific ICD-9-CM codes would improve its validity. As it currently stands, PSI 7 should not be used as a pay-for-performance measure, but should be limited to use in internal quality improvement efforts.
authors.affiliation: Department of Surgery, VA Boston Healthcare System, Boston, MA, USA.
authors.forename: Marisa
authors.initials: M
authors.lastname: Cevasco
authors.forename: Ann M
authors.initials: AM
authors.lastname: Borzecki
authors.forename: William J
authors.initials: WJ
authors.lastname: O'Brien
authors.forename: Qi
authors.initials: Q
authors.lastname: Chen
authors.forename: Marlena H
authors.initials: MH
authors.lastname: Shin
authors.forename: Kamal M F
authors.initials: KM
authors.lastname: Itani
authors.forename: Amy K
authors.initials: AK
authors.lastname: Rosen
mesh_terms: D000368:Aged; D016470:Bacteremia / Q000453:epidemiology / Q000382:microbiology; D002405:Catheterization, Central Venous / Q000009:adverse effects* / Q000706:statistics & numerical data*; D059019:Clinical Coding / Q000592:standards; D015986:Confounding Factors, Epidemiologic; D003430:Cross-Sectional Studies; D005189:False Positive Reactions; D005260:Female; D016469:Fungemia / Q000453:epidemiology / Q000382:microbiology; D006302:Health Services Research; D006787:Hospitals, Veterans / Q000706:statistics & numerical data*; D006801:Humans; D007297:Inpatients; D008297:Male; D019300:Medical Errors / Q000517:prevention & control / Q000706:statistics & numerical data; D016347:Medical Records Systems, Computerized; D008875:Middle Aged; D011183:Postoperative Complications / Q000453:epidemiology* / Q000517:prevention & control; D011237:Predictive Value of Tests; D019984:Quality Indicators, Health Care / Q000592:standards* / Q000639:trends; D015203:Reproducibility of Results; D012107:Research Design; D012189:Retrospective Studies; D012307:Risk Factors; D017751:Safety Management / Q000592:standards*; D018805:Sepsis / Q000150:complications / Q000453:epidemiology* / Q000209:etiology / Q000382:microbiology* / Q000517:prevention & control; D016896:Treatment Outcome; D014481:United States / Q000453:epidemiology