title: Using patient-reported outcomes (PROs) to compare the providers of surgery: does the choice of measure matter?
abstract: BACKGROUND
  Patient-reported outcomes (PROs) are being used to compare health care providers with little knowledge of how the choice of measure affects such comparisons.
  
  
  OBJECTIVE
  To assess how much difference the choice of PRO makes to a provider's adjusted outcome and whether the choice affects a provider's rating.
  
  
  METHODS
  PROs collected in England from patients undergoing: hip replacement (243 providers; 52,692 patients); knee replacement (244; 60,118); varicose vein surgery (100; 11,163); and groin hernia repair (201; 31,714). Four case-mix-adjusted outcomes (mean postoperative disease-specific and generic PRO; proportion achieving a minimally important difference in disease-specific PRO; proportion reporting improvement on single transitional item). We calculated the associations between measures and for each measure, the proportion of providers rated as statistically above or below average and the level of agreement in ratings.
  
  
  RESULTS
  For major surgery, disease-specific PROs were strongly correlated with the generic PRO (hip 0.90; knee 0.88), they rated high proportions of providers as above or below average (hip 25.1%; knee 19.3%) and there was agreement in ratings with the generic PRO. Even so, for a large proportion of providers (hip 30%; knee 16%) their rating depended on the choice of measure. For minor surgery, correlations between measures were mostly weak. The single transitional item identified the most outliers (varicose vein 20%, hernia 10%).
  
  
  CONCLUSIONS
  Choice of outcome measure can determine a provider's rating. Measure selection depends on whether the priority is to avoid missing "poor" providers or avoid mislabeling average providers as "poor."
authors: Department of Health Services Research & Policy, London School of Hygiene & Tropical Medicine, London, UK.
authors: Jenny
authors: J
authors: Neuburger
authors: Andrew
authors: A
authors: Hutchings
authors: Jan
authors: J
authors: van der Meulen
authors: Nick
authors: N
authors: Black
mesh_terms: D019644:Arthroplasty, Replacement, Hip; D019645:Arthroplasty, Replacement, Knee; D015897:Comorbidity; D003953:Diagnosis-Related Groups; D017558:Elective Surgical Procedures / Q000592:standards*; D004739:England; D005260:Female; D046449:Hernia, Abdominal / Q000601:surgery; D006801:Humans; D016014:Linear Models; D008297:Male; D017063:Outcome Assessment, Health Care; D017060:Patient Satisfaction; D011787:Quality of Health Care; D012307:Risk Factors; D011795:Surveys and Questionnaires; D014648:Varicose Veins / Q000601:surgery