Meaningful variation in performance: what does variation in quality tell us about improving quality?
BACKGROUND
Variance reduction is sometimes considered as a goal of clinical quality improvement. Variance among physicians, hospitals, or health plans has been evaluated as the proportion of total variance (or intraclass correlation, ICC) in a quality measure; low ICCs have been interpreted to indicate low potential for quality improvement at that level. However, the absolute amount of variation, expressed in clinically meaningful units, is less frequently reported. Moreover, changes in variance components have not been studied as quality improves.


OBJECTIVE
To examine changes in variance components at primary care physician and medical facility levels as performance improved for 4 quality indicators: systolic blood pressure levels in hypertension; low-density lipoprotein-cholesterol levels in hyperlipidemia; patient-reported care experience scores after primary care visits; and mammography screening rates.


METHODS
Adult members (n = 62,596-410,976) of Kaiser Permanente in Northern California, served by more than 1000 primary care physicians in 35 facilities, from 2001 to 2006.


METHODS
Multilevel linear and logistic regression to examine the interphysician and interfacility variances in 4 quality indicators over 6 years, after case-mix adjustment.


RESULTS
ICCs were low for all 4 indicators at both levels (0.0021-0.086). Nevertheless, variances at both levels were statistically and clinically significant. For systolic blood pressure and the care experience score, interfacility and interphysician variance as well as ICCs decreased further as quality improved; declines were greater at the facility level. For low-density lipoprotein-cholesterol, variability at both levels increased with quality improvement; and for screening mammography, small declines were not statistically significant for either physicians or facilities.


CONCLUSIONS
Low proportions of variance do not predict low potential for quality improvement. Despite low ICCs for facilities, quality improvement efforts directed primarily at facilities improved quality for all 4 indicators.
Selby
Joseph V
JV
Division of Research, Kaiser Permanente Medical Care Program, Oakland, CA 94612, USA. joe.selby@kp.org
Schmittdiel
Julie A
JA
Lee
Janelle
J
Fung
Vicki
V
Thomas
Sean
S
Smider
Nancy
N
Crosson
Francis J
FJ
Hsu
John
J
Fireman
Bruce
B
D000328:Adult; D002140:California; D002983:Clinical Competence; D019983:Guideline Adherence; D006801:Humans; D006949:Hyperlipidemias / Q000628:therapy; D006973:Hypertension / Q000628:therapy; D016014:Linear Models; D016015:Logistic Models; D008327:Mammography / Q000706:statistics & numerical data; D015999:Multivariate Analysis; D010043:Outcome and Process Assessment, Health Care; D017060:Patient Satisfaction; D010818:Practice Patterns, Physicians'; D011320:Primary Health Care; D011785:Quality Assurance, Health Care; D019984:Quality Indicators, Health Care