title: Designing an abstraction instrument: lessons from efforts to validate the AHRQ patient safety indicators.
abstract: BACKGROUND
  The U.S. Agency for Healthcare Research and Quality (AHRQ) and other organizations have developed quality indicators based on hospital administrative data. Characteristics of effective abstraction instruments were identified for determining both the positive predictive value (PPV) of Patient Safety Indicators (PSIs) and the extent to which hospitals and clinicians could have prevented adverse events.
  
  
  METHODS
  Through an iterative process involving nurse abstractors, physicians, and nurses with quality improvement experience, and health services researchers, 25 abstraction instruments were designed for 12 AHRQ provider-level morbidity PSIs. Data were analyzed from 13 of these instruments, and data are being collected using several more.
  
  
  RESULTS
  Common problems in designing the instruments included avoiding uninformative questions and premature termination of the abstraction process, anticipating misinterpretation of questions, allowing an appropriate range of response options; using clear terminology, optimizing the flow of the abstraction process, balancing the utility of data against abstractor burden, and recognizing the needs of end users, such as hospitals and quality improvement professionals and researchers, for the abstracted information.
  
  
  CONCLUSIONS
  Designing medical record abstraction instruments for quality improvement research involves several potential pitfalls. Understanding how we addressed these challenges might help both investigators and users of outcome indicators to appreciate the strengths and limitations of outcome-based quality indicators and tools designed to validate or investigate such indicators within provider organizations.
authors.affiliation: Department of Surgery, University of California, Davis, Medical Center, Sacramento, California, USA. Garth.utter@ucdmc.ucdavis.edu
authors.forename: Garth H
authors.initials: GH
authors.lastname: Utter
authors.forename: Ann M
authors.initials: AM
authors.lastname: Borzecki
authors.forename: Amy K
authors.initials: AK
authors.lastname: Rosen
authors.forename: Patricia A
authors.initials: PA
authors.lastname: Zrelak
authors.forename: Banafsheh
authors.initials: B
authors.lastname: Sadeghi
authors.forename: Ruth
authors.initials: R
authors.lastname: Baron
authors.forename: Joanne
authors.initials: J
authors.lastname: Cuny
authors.forename: Haytham M A
authors.initials: HM
authors.lastname: Kaafarani
authors.forename: Jeffrey J
authors.initials: JJ
authors.lastname: Geppert
authors.forename: Patrick S
authors.initials: PS
authors.lastname: Romano
mesh_terms: D006739:Hospital Administration; D006801:Humans; D058996:Quality Improvement / Q000458:organization & administration*; D019984:Quality Indicators, Health Care / Q000458:organization & administration*; D015203:Reproducibility of Results; D017751:Safety Management / Q000458:organization & administration*; D014481:United States; D016270:United States Agency for Healthcare Research and Quality