title: [The validity of routine data on quality assurance: A qualitative systematic review].
abstract: BACKGROUND
  The assessment of the quality of medical practice is a legitimate requirement by society. Reliable methods for measurement of the quality of performance are sought worldwide. Quality is often quantified by using administrative data and in Germany this method has been implemented by the health insurance company AOK.
  
  
  OBJECTIVE
  (1) How is the AOK quality system rated by senior consultant surgeons? (2) How valid are quality statements derived from administrative data?
  
  
  METHODS
  This article was compiled following the PRISMA (i.e. preferred reporting items for systematic reviews and meta-analyses) statement for qualitative systematic reviews. In order to answer the first question the Professional Association of German Surgeons (Berufsverband der Deutschen Chirurgen) initiated two surveys and to answer the second question a structured literature search following the PICO (i.e. patient problem or population, intervention, comparison control or comparator and outcomes) format was initiated. In addition numerous websites were contacted.
  
  
  RESULTS
  Of the responding senior consultant surgeons 95% considered that the AOK method of quality measurement by administrative data is not objective. One third was definitely wrongly classified. The literature search revealed that no validation data exist for the AOK indicators, including the Elixhauser comorbidity risk score. Altogether, the sensitivity of indicators is poor when good sensitivity is defined by the Institute for Applied Quality Improvement and Research in Health Care (AQUA Institute) as ≥ 80 < 90%.
  
  
  CONCLUSIONS
  Quality statements resulting from administrative data alone are unreliable.
authors.affiliation: Asklepios Klinik Langen, Röntgenstr 20, 63225, Langen, Deutschland. e.hanisch@asklepios.com.
authors.forename: E
authors.initials: E
authors.lastname: Hanisch
authors.affiliation: Heilig-Geist-Hospital Bingen, Bingen, Deutschland.
authors.forename: T F
authors.initials: TF
authors.lastname: Weigel
authors.affiliation: Asklepios Klinik Langen, Röntgenstr 20, 63225, Langen, Deutschland.
authors.forename: A
authors.initials: A
authors.lastname: Buia
authors.affiliation: Berufsverband der Deutschen Chirurgen, Langenbeck-Virchow-Haus, Berlin, Deutschland.
authors.forename: H-P
authors.initials: HP
authors.lastname: Bruch
mesh_terms: D001291:Attitude of Health Personnel; D000068598:Data Accuracy; D003625:Data Collection; D005858:Germany; D019538:Health Care Surveys; D006801:Humans; D009313:National Health Programs / Q000592:standards / Q000706:statistics & numerical data; D011785:Quality Assurance, Health Care / Q000592:standards* / Q000706:statistics & numerical data*; D019984:Quality Indicators, Health Care / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D013514:Surgical Procedures, Operative / Q000592:standards* / Q000706:statistics & numerical data*
keywords: AOK quality system; Administrative data; Medical performance; Quality assurance; Validity