title: Reliability of in-hospital mortality as a quality indicator in clinical quality registries. A case study in an intensive care quality register.
abstract: OBJECTIVE
  Errors in the registration or extraction of patient outcome data, such as in-hospital mortality, may lower the reliability of the quality indicator that uses this (partly) incorrect data. Our aim was to measure the reliability of in-hospital mortality registration in the Dutch National Intensive Care Evaluation (NICE) registry.
  
  
  METHODS
  We linked data of the NICE registry with an insurance claims database, resulting in a list of discrepancies in in-hospital mortality. Eleven Intensive Care Units (ICUs) were visited where local data sources were investigated to find the true in-hospital mortality status of the discrepancies and to identify the causes of the data errors in the NICE registry. Original and corrected Standardized Mortality Ratios (SMRs) were calculated to determine if conclusions about quality of care changed compared to the national benchmark.
  
  
  RESULTS
  In eleven ICUs, 23,855 records with 460 discrepancies were identified of which 255 discrepancies (1.1% of all linked records) were due to incorrect in-hospital mortality registration in the NICE registry. Two programming errors in computer software of six ICUs caused 78% of errors, the remainder was caused by manual transcription errors and failure to record patient outcomes. For one ICU the performance became concordant with the national benchmark after correction, instead of being better.
  
  
  CONCLUSIONS
  The reliability of in-hospital mortality registration in the NICE registry was good. This was reflected by the low number of data errors and by the fact that conclusions about the quality of care were only affected for one ICU due to systematic data errors. We recommend that registries frequently verify the software used in the registration process, and compare mortality data with an external source to assure consistent quality of data.
authors.affiliation: Antonie Koetsier, MSc Department of Medical Informatics, Academic Medical Center, Room J1b-115-2, P.O. Box 22700, 1100 DE Amsterdam, The Netherlands, E-mail: a.koetsier@amc.uva.nl.
authors.forename: A
authors.initials: A
authors.lastname: Koetsier
authors.forename: N
authors.initials: N
authors.lastname: Peek
authors.forename: E
authors.initials: E
authors.lastname: de Jonge
authors.forename: D
authors.initials: D
authors.lastname: Dongelmans
authors.forename: G
authors.initials: G
authors.lastname: van Berkel
authors.forename: N
authors.initials: N
authors.lastname: de Keizer
mesh_terms: D057225:Data Mining; D016208:Databases, Factual; D017052:Hospital Mortality; D006801:Humans; D007362:Intensive Care Units; D009426:Netherlands; D019982:Organizational Case Studies; D019984:Quality Indicators, Health Care; D012042:Registries; D015203:Reproducibility of Results
keywords: Quality assurance; hospital mortality; registries; risk adjustment; root cause analysis