Three methods of multi-source feedback compared: a plea for narrative comments and coworkers' perspectives.
BACKGROUND
Doctor performance assessments based on multi-source feedback (MSF) are increasingly central in professional self-regulation. Research has shown that simple MSF is often unproductive. It has been suggested that MSF should be delivered by a facilitator and combined with a portfolio.


OBJECTIVE
To compare three methods of MSF for consultants in the Netherlands and evaluate the feasibility, topics addressed and perceived impact upon clinical practice.


METHODS
In 2007, 38 facilitators and 109 consultants participated in the study. The performance assessment system was composed of (i) one of the three MSF methods, namely, Violato's Physician Achievement Review (PAR), the method developed by Ramsey et al. for the American Board of Internal Medicine (ABIM), or the Dutch Appraisal and Assessment Instrument (AAI), (ii) portfolio, (iii) assessment interview with a facilitator and (iv) personal development plan. The evaluation consisted of a postal survey for facilitators and consultants. Generalized estimating equations were used to assess the association between MSF method used and perceived impact.


RESULTS
It takes on average 8 hours to conduct one assessment. The CanMEDS roles 'collaborator', 'communicator' and 'manager' were discussed in, respectively, 79, 74 and 71% of the assessment interviews. The 'health advocate role' was the subject of conversation in 35% of the interviews. Consultants are more satisfied with feedback that contains narrative comments. The perceived impact of MSF that includes coworkers' perspectives significantly exceeds the perceived impact of methods not including this perspective.


CONCLUSIONS
Performance assessments based on MSF combined with a portfolio and a facilitator-led interview seem to be feasible in hospital settings. The perceived impact of MSF increases when it contains coworkers' perspectives.
Overeem
K
K
IQ Healthcare, Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands. k.overeem@iq.umcn.nl
Lombarts
M J M H
MJ
Arah
O A
OA
Klazinga
N S
NS
Grol
R P T M
RP
Wollersheim
H C
HC
D002983:Clinical Competence; D003253:Consultants; D004650:Employee Performance Appraisal / Q000379:methods*; D030141:Feedback, Psychological; D006739:Hospital Administration; D006801:Humans; D010820:Physicians; D010818:Practice Patterns, Physicians'