title: Interpreting multisource feedback: online study of consensus and variation among GP appraisers.
abstract: BACKGROUND
  GPs collect multisource feedback (MSF) about their professional practice and discuss it at appraisal. Appraisers use such information to identify concerns about a doctor's performance, and to guide the doctor's professional development plan (PDP).
  
  
  OBJECTIVE
  To investigate whether GP appraisers detect variation in doctors' MSF results, and the degree of consensus in appraisers' interpretations of this information.
  
  
  METHODS
  Online study of GP appraisers in north-east England.
  
  
  METHODS
  GP appraisers were invited to review eight anonymised doctors' MSF reports, which represented different patterns of scores on the UK General Medical Council's Patient and Colleague Questionnaires. Participants provided a structured assessment of each doctor's report, and recommended actions for their PDP. Appraiser ratings of each report were summarised descriptively. An 'agreement score' was calculated for each appraiser to determine whether their assessments were more lenient than those of other participants.
  
  
  RESULTS
  At least one report was assessed by 101/146 appraisers (69%). The pattern of appraisers' ratings suggested that they could detect variation in GPs' MSF results, and recommend reasonable actions for the doctors' PDP. Increasing appraiser age was associated with more favourable interpretations of MSF results.
  
  
  CONCLUSIONS
  Although preliminary, the finding of broad consensus among GP appraisers in their assessment of MSF reports should be reassuring for GPs, appraisers, and employing organisations. However, if older appraisers are more lenient than younger appraisers in their interpretation of MSF and in the actions they suggest to their appraisees as a result, organisations need to consider what steps could be taken to address such differences.
authors.affiliation: Primary Care Research Group, University of Exeter Medical School, Exeter.
authors.forename: Christine
authors.initials: C
authors.lastname: Wright
authors.affiliation: Primary Care Research Group, University of Exeter Medical School, Exeter.
authors.forename: John
authors.initials: J
authors.lastname: Campbell
authors.affiliation: Technology Enhanced Learning for Medicine and Dentistry (TELMeD) Team, Plymouth University Peninsula Schools of Medicine and Dentistry and Peninsula College of Medicine and Dentistry, Plymouth.
authors.forename: Luke
authors.initials: L
authors.lastname: McGowan
authors.affiliation: Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Plymouth University Peninsula Schools of Medicine and Dentistry, Plymouth.
authors.forename: Martin J
authors.initials: MJ
authors.lastname: Roberts
authors.affiliation: Health Education (North East and Cumbria), Newcastle.
authors.forename: Di
authors.initials: D
authors.lastname: Jelley
authors.affiliation: Technology Enhanced Learning for Medicine and Dentistry (TELMeD) Team, Plymouth University Peninsula Schools of Medicine and Dentistry and Peninsula College of Medicine and Dentistry, Plymouth.
authors.forename: Arunangsu
authors.initials: A
authors.lastname: Chatterjee
mesh_terms: D001291:Attitude of Health Personnel; D019985:Benchmarking; D002983:Clinical Competence; D032921:Consensus; D003406:Credentialing; D004650:Employee Performance Appraisal / Q000592:standards; D004739:England / Q000453:epidemiology; D005246:Feedback; D058006:General Practice / Q000592:standards; D006801:Humans; D007400:Interprofessional Relations; D010820:Physicians; D016730:Program Development; D036301:Qualitative Research
keywords: appraiser; general practitioners; multisource feedback; primary health care; revalidation