title: Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals.
abstract: OBJECTIVE
  To assess the validity of case mix adjustment methods used to derive standardised mortality ratios for hospitals, by examining the consistency of relations between risk factors and mortality across hospitals.
  
  
  METHODS
  Retrospective analysis of routinely collected hospital data comparing observed deaths with deaths predicted by the Dr Foster Unit case mix method.
  
  
  METHODS
  Four acute National Health Service hospitals in the West Midlands (England) with case mix adjusted standardised mortality ratios ranging from 88 to 140.
  
  
  METHODS
  96 948 (April 2005 to March 2006), 126 695 (April 2006 to March 2007), and 62 639 (April to October 2007) admissions to the four hospitals.
  
  
  METHODS
  Presence of large interaction effects between case mix variable and hospital in a logistic regression model indicating non-constant risk relations, and plausible mechanisms that could give rise to these effects.
  
  
  RESULTS
  Large significant (P<or=0.0001) interaction effects were seen with several case mix adjustment variables. For two of these variables-the Charlson (comorbidity) index and emergency admission-interaction effects could be explained credibly by differences in clinical coding and admission practices across hospitals.
  
  
  CONCLUSIONS
  The Dr Foster Unit hospital standardised mortality ratio is derived from an internationally adopted/adapted method, which uses at least two variables (the Charlson comorbidity index and emergency admission) that are unsafe for case mix adjustment because their inclusion may actually increase the very bias that case mix adjustment is intended to reduce. Claims that variations in hospital standardised mortality ratios from Dr Foster Unit reflect differences in quality of care are less than credible.
authors.affiliation: Unit of Public Health, Epidemiology and Biostatistics, University of Birmingham, Birmingham B15 2TT. M.A.Mohammed@Bham.ac.uk
authors.forename: Mohammed A
authors.initials: MA
authors.lastname: Mohammed
authors.forename: Jonathan J
authors.initials: JJ
authors.lastname: Deeks
authors.forename: Alan
authors.initials: A
authors.lastname: Girling
authors.forename: Gavin
authors.initials: G
authors.lastname: Rudge
authors.forename: Martin
authors.initials: M
authors.lastname: Carmalt
authors.forename: Andrew J
authors.initials: AJ
authors.lastname: Stevens
authors.forename: Richard J
authors.initials: RJ
authors.lastname: Lilford
mesh_terms: D015982:Bias; D004630:Emergencies / Q000453:epidemiology; D004739:England / Q000453:epidemiology; D017052:Hospital Mortality; D007902:Length of Stay / Q000706:statistics & numerical data; D010343:Patient Admission / Q000706:statistics & numerical data; D012044:Regression Analysis; D012189:Retrospective Studies; D020379:Risk Adjustment / Q000706:statistics & numerical data*; D012307:Risk Factors