title: Apples and oranges: comparison of ACS-NSQIP observed outcomes with premier's quality manager-predicted outcomes.
abstract: The National Surgical Quality Improvement Program (NSQIP) is used by the American College of Surgeons to measure and report surgical quality and outcomes. Premier's Quality Manager (QM) generates expected outcomes from patient charts. The authors compared observed NSQIP morbidity and mortality outcomes with those predicted by QM. NSQIP data for 1919 patients were entered into QM. The discriminatory accuracy of the QM model was assessed using the C statistic (1.0 implies perfect discrimination, and 0.5 implies no discrimination). NSQIP and QM both identified 51 deaths (C statistic, 0.91). NSQIP identified 478 postoperative occurrences, whereas QM predicted 714 patients with at least 1 complication; 223 of these were subclassified as patients with at least 1 morbid complication (C statistic, 0.83). QM did not perform as well in predicting the observed NSQIP morbidities. Surgical leaders and hospital administrators must critically evaluate products before adopting programs designed to improve patient outcomes or making decisions regarding physician practice.
authors.affiliation: Dept. of Surgery, Inova Fairfax Hospital, Falls Church, VA 22151, USA.
authors.forename: Louis C
authors.initials: LC
authors.lastname: Lee
authors.forename: H David
authors.initials: HD
authors.lastname: Reines
authors.forename: Michael J
authors.initials: MJ
authors.lastname: Sheridan
authors.forename: Barbara E
authors.initials: BE
authors.lastname: Farmer
authors.forename: John
authors.initials: J
authors.lastname: Martin
authors.forename: Michael
authors.initials: M
authors.lastname: Duan
mesh_terms: D006801:Humans; D017063:Outcome Assessment, Health Care / Q000379:methods*; D011183:Postoperative Complications / Q000453:epidemiology* / Q000401:mortality; D058996:Quality Improvement / Q000706:statistics & numerical data*; D019984:Quality Indicators, Health Care; D013514:Surgical Procedures, Operative / Q000009:adverse effects* / Q000401:mortality / Q000706:statistics & numerical data*