title: An investigation into the use of multi-source feedback (MSF) as a work-based assessment tool.
abstract: BACKGROUND
  This study compared Specialist Trainees' (STs) hand-selected multi-source feedback (MSF) scores with those made by their clinical supervisors and explored perceptions of both those being assessed and those assessing.
  
  
  METHODS
  Participating STs were asked to hand a mini-PAT questionnaire to a clinical colleague of their choice and also to their Clinical Supervisor. Statistical analysis was carried out on submitted paired assessments to determine any differences in responses between clinical supervisors and hand-chosen assessors. Semi-structured interviews were held with seven nurses, seven Consultants and six postgraduate doctors.
  
  
  RESULTS
  Forty pairs of mini-PAT questionnaires were analysed. Hand-chosen assessors' ratings were significantly higher than those for clinical supervisors with respect to: "good clinical care" (p < 0.01), "good medical practice" (p < 0.05), "teaching and training" (p < 0.01), "relationship with patients" (p < 0.05) as well as for overall impression of the trainee (p < 0.05). Five themes were identified from interviews: validity of selecting assessors; anonymity of assessors; usefulness of feedback; the value of multi-professional assessors; and grading.
  
  
  CONCLUSIONS
  There is a systematic difference in the assessment scores for trainees in MSF between clinical supervisors and hand-chosen assessors, the former scoring trainees more harshly. Grading was open to interpretation. This raised questions, especially from nurse interviewees regarding appropriate benchmarking.
authors.affiliation: Edge Hill University , UK .
authors.forename: Jeremy M
authors.initials: JM
authors.lastname: Brown
authors.forename: Kathryn
authors.initials: K
authors.lastname: Lowe
authors.forename: Jill
authors.initials: J
authors.lastname: Fillingham
authors.forename: Philip N
authors.initials: PN
authors.lastname: Murphy
authors.forename: Margaret
authors.initials: M
authors.lastname: Bamforth
authors.forename: N J Ben
authors.initials: NJ
authors.lastname: Shaw
mesh_terms: D002983:Clinical Competence; D004503:Education, Medical, Graduate / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D005246:Feedback; D006801:Humans; D015203:Reproducibility of Results