title: Persistence of HMO performance measures.
abstract: OBJECTIVE
  To simplify the decision-making process, we propose and implement an approach to assess the stability of health plan performance over time when multiple indicators of performance exist.
  
  
  METHODS
  National Committee for Quality Assurance Health Care Effectiveness Data and Information Set data for childhood immunization for both publicly and non-publicly reporting health plans between 1998 and 2002. DATA/STUDY DESIGN: We use longitudinal data to examine whether plan quality ratings are stable from year to year. We estimate a parametric Multiple Indicator Multiple Cause Model, a model which allows us to aggregate the multiple measures of performance. The model controls for observed characteristics of the plan and market, allowing for unmeasured heterogeneity.
  
  
  RESULTS
  We find moderate persistence in plan performance over time. A plan in the upper tier of performance in the year 1999 has only a 0.47 probability of remaining in the upper tier in the year 2001. Multiple years of good performance increase the probability of good performance in the future. For example, from the subset of plans in the upper tier of performance in 1999, 63 percent continued to perform in the upper tier in 2000. However, from the subset of plans in the upper tier in both 1998 and 1999, about three-fourths of the plans continued to perform in the upper tier in the year 2000. Finally, better performance in the more recent past is more indicative of better performance in the future than better performance in the more distant past.
  
  
  CONCLUSIONS
  Although there is some persistence in health plan ratings over time, it is not uncommon for ratings of plans to change between when the data are generated and when actions based on that data, such as employers' contracting decisions or consumers' enrollment decisions, may take effect. Decision makers should be cognizant of this issue and methods should be developed to mitigate its consequences.
authors.affiliation: Center for Gerontology and Health Care Research, Brown University, 121 South Main Street, Providence, RI 02912, USA. Shailender_Swaminathan@brown.edu
authors.forename: Shailender
authors.initials: S
authors.lastname: Swaminathan
authors.forename: Michael
authors.initials: M
authors.lastname: Chernew
authors.forename: Dennis P
authors.initials: DP
authors.lastname: Scanlon
mesh_terms: D000465:Algorithms; D017598:Efficiency, Organizational; D006279:Health Maintenance Organizations; D017589:Immunization Programs / Q000592:standards* / Q000639:trends; D008137:Longitudinal Studies; D015233:Models, Statistical; D011785:Quality Assurance, Health Care / Q000592:standards*; D019984:Quality Indicators, Health Care / Q000706:statistics & numerical data
references.citation: JAMA. 2002 Sep 25;288(12):1484-90
references.pmid: 12243635
references.citation: Health Serv Res. 2001 Jul;36(3):619-41
references.pmid: 11482592
references.citation: Med Care. 2005 Apr;43(4):338-46
references.pmid: 15778637
references.citation: Jt Comm J Qual Improv. 1998 Jan;24(1):5-20
references.pmid: 9494870
references.citation: JAMA. 1993 Jul 21;270(3):331-7
references.pmid: 8315777
references.citation: Med Care Res Rev. 2006 Dec;63(6 Suppl):56S-89S
references.pmid: 17099130
references.citation: JAMA. 1999 Jul 28;282(4):363-70
references.pmid: 10432034
references.citation: Med Care Res Rev. 2006 Dec;63(6 Suppl):37S-55S
references.pmid: 17099129