title: Investigating the meaning of 'good' or 'very good' patient evaluations of care in English general practice: a mixed methods study.
abstract: To examine concordance between responses to patient experience survey items evaluating doctors' interpersonal skills, and subsequent patient interview accounts of their experiences of care.
  
  
  
  Mixed methods study integrating data from patient questionnaires completed immediately after a video-recorded face-to-face consultation with a general practitioner (GP) and subsequent interviews with the same patients which included playback of the recording.
  
  
  
  12 general practices in rural, urban and inner city locations in six areas in England.
  
  
  
  50 patients (66% female, aged 19-96 years) consulting face-to-face with 32 participating GPs.
  
  
  
  Positive responses to interpersonal skills items in a postconsultation questionnaire ('good' and 'very good') were compared with experiences reported during subsequent video elicitation interview (categorised as positive, negative or neutral by independent clinical raters) when reviewing that aspect of care.
  
  
  
  We extracted 230 textual statements from 50 interview transcripts which related to the evaluation of GPs' interpersonal skills. Raters classified 70.9% (n=163) of these statements as positive, 19.6% (n=45) neutral and 9.6% (n=22) negative. Comments made by individual patients during interviews did not always express the same sentiment as their responses to the questionnaire. Where questionnaire responses indicated that interpersonal skills were 'very good', 84.6% of interview statements concerning that item were classified as positive. However, where patients rated interpersonal skills as 'good', only 41.9% of interview statements were classified as positive, and 18.9% as negative.
  
  
  
  Positive responses on patient experience questionnaires can mask important negative experiences which patients describe in subsequent interviews. The interpretation of absolute patient experience scores in feedback and public reporting should be done with caution, and clinicians should not be complacent following receipt of 'good' feedback. Relative scores are more easily interpretable when used to compare the performance of providers.
authors.affiliation: Cambridge Centre for Health Services Research, Primary Care Unit, Institute of Public Health, Forvie Site, University of Cambridge School of Clinical Medicine, Cambridge, UK.
authors.forename: Jenni
authors.identifier: 0000-0002-0037-274X
authors.initials: J
authors.lastname: Burt
authors.affiliation: Cambridge Centre for Health Services Research, Primary Care Unit, Institute of Public Health, Forvie Site, University of Cambridge School of Clinical Medicine, Cambridge, UK.
authors.forename: Jenny
authors.initials: J
authors.lastname: Newbould
authors.affiliation: University of Exeter Medical School, Exeter, UK.
authors.forename: Gary
authors.identifier: 0000-0003-2231-5161
authors.initials: G
authors.lastname: Abel
authors.affiliation: Distinguished Chair in Statistics; Senior Principal Researcher, RAND Corporation, Santa Monica, California, USA.
authors.forename: Marc N
authors.initials: MN
authors.lastname: Elliott
authors.affiliation: Cambridge Centre for Health Services Research, Primary Care Unit, Institute of Public Health, Forvie Site, University of Cambridge School of Clinical Medicine, Cambridge, UK.
authors.forename: Julia
authors.initials: J
authors.lastname: Beckwith
authors.affiliation: Cambridge Centre for Health Services Research, Primary Care Unit, Institute of Public Health, Forvie Site, University of Cambridge School of Clinical Medicine, Cambridge, UK.
authors.forename: Nadia
authors.initials: N
authors.lastname: Llanwarne
authors.affiliation: Cambridge Centre for Health Services Research, Primary Care Unit, Institute of Public Health, Forvie Site, University of Cambridge School of Clinical Medicine, Cambridge, UK.
authors.forename: Natasha
authors.initials: N
authors.lastname: Elmore
authors.affiliation: University of Exeter Medical School, Exeter, UK.
authors.forename: Antoinette
authors.initials: A
authors.lastname: Davey
authors.affiliation: Cambridge Centre for Health Services Research, Primary Care Unit, Institute of Public Health, Forvie Site, University of Cambridge School of Clinical Medicine, Cambridge, UK.
authors.forename: Chris
authors.initials: C
authors.lastname: Gibbons
authors.affiliation: University of Exeter Medical School, Exeter, UK.
authors.forename: John
authors.initials: J
authors.lastname: Campbell
authors.affiliation: Cambridge Centre for Health Services Research, Primary Care Unit, Institute of Public Health, Forvie Site, University of Cambridge School of Clinical Medicine, Cambridge, UK.
authors.forename: Martin
authors.initials: M
authors.lastname: Roland
mesh_terms: D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D005260:Female; D058006:General Practice; D058005:General Practitioners / Q000592:standards*; D006801:Humans; D007802:Language; D008297:Male; D008875:Middle Aged; D017060:Patient Satisfaction; D010817:Physician-Patient Relations; D066107:Social Skills; D011795:Surveys and Questionnaires; D055815:Young Adult
keywords: PRIMARY CARE; QUALITATIVE RESEARCH