title: Health plan report cards: exploring differences in plan ratings.
abstract: BACKGROUND
  Despite the considerable attention paid to the collection of data and the publication of health plan report cards, there is no available study on the comparability of published report cards. Ratings from seven health plan report cards publicly available in fall 1996 were compared--including those produced by major periodicals, a large national employer, a nonprofit consumer group, a health maintenance organization accreditation agency, and a consortium of employers.
  
  
  METHODS
  Dimensions of plan performance common to the seven report cards were identified. Spearman rank correlation coefficients were computed for each pair of report cards for each of the three dimensions that were evaluated. COMPARABILITY OF REPORT CARDS: Although plan ratings tended to be positively correlated as hypothesized, the magnitude of the estimated correlation coefficients varied. For example, the estimated correlation coefficient between two periodicals' overall plan ratings was 0.48. The ranges of estimated correlations were 0.18-0.70 for preventive care (among four report cards) and 0.19-0.73 for enrollee satisfaction (among three report cards).
  
  
  CONCLUSIONS
  Discrepancies in ratings may reflect methodologic issues pertaining to the sample of health plans used, plan performance measures included, and the processes by which individual measures were aggregated to construct indices and ratings. Health plan report cards may be sending mixed signals to consumers. These inconsistencies may explain why focus group studies have found that despite the widespread indication that plan performance measures would be useful, relatively few of those who had seen such information report using it in making their plan choice. Future efforts to evaluate health plans should clearly identify assumptions, methods, normative judgments, and limitations.
authors.affiliation: Department of Health Policy and Administration, Pennsylvania State University, University Park 16802-6500, USA. dpscanlon@psu.edu
authors.forename: D P
authors.initials: DP
authors.lastname: Scanlon
authors.forename: M
authors.initials: M
authors.lastname: Chernew
authors.forename: S
authors.initials: S
authors.lastname: Sheffler
authors.forename: A M
authors.initials: AM
authors.lastname: Fendrick
mesh_terms: D000068:Accreditation; D003255:Consumer Organizations; D003625:Data Collection / Q000379:methods / Q000592:standards; D004651:Employment; D006302:Health Services Research / Q000379:methods*; D006801:Humans; D007255:Information Services / Q000592:standards*; D008329:Managed Care Programs / Q000145:classification / Q000592:standards*; D010506:Periodicals as Topic; D019984:Quality Indicators, Health Care; D012107:Research Design; D018709:Statistics, Nonparametric; D014481:United States