Persistence of HMO performance measures.
OBJECTIVE
To simplify the decision-making process, we propose and implement an approach to assess the stability of health plan performance over time when multiple indicators of performance exist.


METHODS
National Committee for Quality Assurance Health Care Effectiveness Data and Information Set data for childhood immunization for both publicly and non-publicly reporting health plans between 1998 and 2002. DATA/STUDY DESIGN: We use longitudinal data to examine whether plan quality ratings are stable from year to year. We estimate a parametric Multiple Indicator Multiple Cause Model, a model which allows us to aggregate the multiple measures of performance. The model controls for observed characteristics of the plan and market, allowing for unmeasured heterogeneity.


RESULTS
We find moderate persistence in plan performance over time. A plan in the upper tier of performance in the year 1999 has only a 0.47 probability of remaining in the upper tier in the year 2001. Multiple years of good performance increase the probability of good performance in the future. For example, from the subset of plans in the upper tier of performance in 1999, 63 percent continued to perform in the upper tier in 2000. However, from the subset of plans in the upper tier in both 1998 and 1999, about three-fourths of the plans continued to perform in the upper tier in the year 2000. Finally, better performance in the more recent past is more indicative of better performance in the future than better performance in the more distant past.


CONCLUSIONS
Although there is some persistence in health plan ratings over time, it is not uncommon for ratings of plans to change between when the data are generated and when actions based on that data, such as employers' contracting decisions or consumers' enrollment decisions, may take effect. Decision makers should be cognizant of this issue and methods should be developed to mitigate its consequences.
Swaminathan
Shailender
S
Center for Gerontology and Health Care Research, Brown University, 121 South Main Street, Providence, RI 02912, USA. Shailender_Swaminathan@brown.edu
Chernew
Michael
M
Scanlon
Dennis P
DP
D000465:Algorithms; D017598:Efficiency, Organizational; D006279:Health Maintenance Organizations; D017589:Immunization Programs / Q000592:standards* / Q000639:trends; D008137:Longitudinal Studies; D015233:Models, Statistical; D011785:Quality Assurance, Health Care / Q000592:standards*; D019984:Quality Indicators, Health Care / Q000706:statistics & numerical data
JAMA. 2002 Sep 25;288(12):1484-90
12243635
Health Serv Res. 2001 Jul;36(3):619-41
11482592
Med Care. 2005 Apr;43(4):338-46
15778637
Jt Comm J Qual Improv. 1998 Jan;24(1):5-20
9494870
JAMA. 1993 Jul 21;270(3):331-7
8315777
Med Care Res Rev. 2006 Dec;63(6 Suppl):56S-89S
17099130
JAMA. 1999 Jul 28;282(4):363-70
10432034
Med Care Res Rev. 2006 Dec;63(6 Suppl):37S-55S
17099129