title: Patient samples for measuring primary care physician performance: who should be included?
abstract: BACKGROUND
  In measuring patients' experiences with individual primary care physicians (PCPs), the reliability and validity of data based on samples of "established" patients of a physician's panel have been shown. However, as large-scale initiatives seek the least costly approach to obtaining these data, little is known about the implications of expanding samples to include any patient who has seen the physician in the relevant time period.
  
  
  METHODS
  A brief validated patient questionnaire was administered to a random sample of patients visiting 67 PCPs in California between January and October 2005. We evaluated the concordance between administrative and patient-reported information on whether the physician was the patient's PCP. Response rates, data quality, and experiences reported by confirmed "established" patients were compared with those of "unestablished" patients.
  
  
  RESULTS
  Administrative data designating patients as established to a PCP were highly concordant with patient self-report (96.5%). For unestablished patients, concordance was considerably lower (40.0%). Response rates among established patients were higher than those of patients believed to be unestablished (35.5% vs. 22.2%). Compared with established patients of a PCP's practice, unestablished patients reported significantly less favorable experiences with the doctor (interaction quality, P < 0.001; health promotion, P < 0.001; access, P < 0.001; integration, P < 0.05). The ranking of individual physicians differed for established and unestablished patient samples.
  
  
  CONCLUSIONS
  Initiatives measuring patients' experiences with individual primary care physicians will achieve different results (response rates, physician scores) if samples include any patient who has seen the physician versus those whom administrative data indicate as established members of the physician's panel.
authors: Department of Health Services, School of Public Health and Community Medicine, University of Washington, Seattle, Washington 98195-7660, USA. hrod@u.washington.edu
authors: Hector P
authors: HP
authors: Rodriguez
authors: Ted
authors: T
authors: von Glahn
authors: Hong
authors: H
authors: Chang
authors: William H
authors: WH
authors: Rogers
authors: Dana Gelb
authors: DG
authors: Safran
mesh_terms: D005260:Female; D006304:Health Status; D006801:Humans; D008297:Male; D008875:Middle Aged; D017060:Patient Satisfaction; D010361:Patients; D010817:Physician-Patient Relations; D010821:Physicians, Family / Q000592:standards*; D011787:Quality of Health Care / Q000592:standards; D015203:Reproducibility of Results; D012494:Sampling Studies; D012959:Socioeconomic Factors; D011795:Surveys and Questionnaires / Q000592:standards*