The effect of clustering of outcomes on the association of procedure volume and surgical outcomes.
BACKGROUND
A large body of literature documents associations between the volume of cases a hospital or surgeon treats and clinical outcomes. Most of these studies have used conventional statistical methods that do not recognize the fact that hospitals or surgeons with similar volumes may have very different outcomes because of systematic differences in processes of care, a phenomenon that exaggerates the true statistical significance of the effect of volume on outcome.


OBJECTIVE
To describe methods to assess the degree of this "clustering" of outcomes and to explore the impact of available statistical techniques that correct for clustering.


METHODS
Reanalysis of 3 previously published volume-outcome studies.


METHODS
Medicare beneficiaries 65 years of age or older undergoing surgery for colon, prostate, or rectal cancer in the population defined by the Surveillance, Epidemiology, and End Results cancer registries during 1992 to 1996.


METHODS
3 data sets were analyzed to assess the impact of surgeon volume on outcomes: 1) 24 166 colectomies performed by 2682 surgeons, 2) 10 737 prostatectomies performed by 999 surgeons, and 3) 2603 rectal resections performed by 1141 surgeons.


METHODS
Volume-outcome trends were analyzed by a conventional method (logistic regression) and corrected for clustering. Two widely used statistical methods for analyzing clustered data, a random-effects model and generalized estimating equations, were used and compared, and the degree of clustering was presented graphically.


RESULTS
Substantial clustering was observed in the analyses involving morbidity end points. The 2 statistical techniques produced noticeably different results in some analyses.


CONCLUSIONS
The presence of clustering represents variations in outcomes among providers with similar volumes. Thus, in volume-outcome studies, the degree of clustering of outcomes should be characterized because it may provide insight into variations in quality of care.
Memorial Sloan-Kettering Cancer Center, New York, New York 10021, USA.
Katherine S
KS
Panageas
Deborah
D
Schrag
Elyn
E
Riedel
Peter B
PB
Bach
Colin B
CB
Begg
D002983:Clinical Competence; D016000:Cluster Analysis; D003082:Colectomy / Q000706:statistics & numerical data; D003110:Colonic Neoplasms / Q000601:surgery*; D013505:Digestive System Surgical Procedures / Q000706:statistics & numerical data*; D005260:Female; D006761:Hospitals / Q000706:statistics & numerical data*; D006801:Humans; D008297:Male; D017063:Outcome Assessment, Health Care; D011468:Prostatectomy / Q000706:statistics & numerical data*; D011471:Prostatic Neoplasms / Q000601:surgery*; D012004:Rectal Neoplasms / Q000601:surgery*; D018426:SEER Program; D014481:United States