title: User reception of a simple online multisource feedback tool for residents.
abstract: Receiving feedback on daily clinical activities, in whatever form, is crucial for the development of clinical proficiency. Multisource or 360-degree feedback procedures have been recommended to include various co-workers as sources of feedback. In 2008, a web-based multisource feedback (MSF) tool for medical residents was developed at the University Medical Center Utrecht and launched nationally in the Netherlands and has been widely used since then. In 2012, an evaluation was carried out to collect opinions on its use, on the quality of the instrument and on its experienced effectiveness. We approached 408 residents and 59 residency programme directors with an anonymous online survey.Completed surveys were received from 108 residents (26 %) and 22 programme directors (37 %). The tool was well received among the respondents and proved to be a simple, efficient and effective instrument to prepare for information-rich progress interviews of programme directors with their residents. Despite a relatively low response rate, indications were found for the effectiveness of MSF use at four levels of Kirkpatrick's hierarchy based on user impressions: reaction, learning, behaviour change, and impact. This MSF tool, designed for effective formative feedback, was found to meet its purpose and was well received.
authors.affiliation: Center for Research and Development of Education, University Medical Center Utrecht, PO Box # 85500, 3508 GA, Utrecht, The Netherlands.
authors.forename: Lonneke
authors.initials: L
authors.lastname: Alofs
authors.affiliation: Center for Research and Development of Education, University Medical Center Utrecht, PO Box # 85500, 3508 GA, Utrecht, The Netherlands.
authors.forename: Jorike
authors.initials: J
authors.lastname: Huiskes
authors.affiliation: Center of Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.
authors.forename: Maas Jan
authors.initials: MJ
authors.lastname: Heineman
authors.affiliation: Medical Center, Alkmaar, The Netherlands.
authors.forename: Caroline
authors.initials: C
authors.lastname: Buis
authors.affiliation: Family medicine practice, Utrecht, The Netherlands.
authors.forename: Manon
authors.initials: M
authors.lastname: Horsman
authors.affiliation: Center for Research and Development of Education, University Medical Center Utrecht, PO Box # 85500, 3508 GA, Utrecht, The Netherlands.
authors.forename: Lars
authors.initials: L
authors.lastname: van der Plank
authors.affiliation: Center for Research and Development of Education, University Medical Center Utrecht, PO Box # 85500, 3508 GA, Utrecht, The Netherlands. t.j.tencate@umcutrecht.nl.
authors.forename: Olle
authors.initials: O
authors.lastname: Ten Cate
references.citation: Adv Health Sci Educ Theory Pract. 2008 Aug;13(3):275-88
references.pmid: 17091339
references.citation: Acad Med. 2005 Oct;80(10 Suppl):S46-54
references.pmid: 16199457
references.citation: J Grad Med Educ. 2011 Dec;3(4):511-6
references.pmid: 23205200
references.citation: N Engl J Med. 2007 Feb 22;356(8):858-66
references.pmid: 17314348
references.citation: Acad Med. 2010 Jul;85(7):1212-20
references.pmid: 20375832
references.citation: J Contin Educ Health Prof. 2003 Winter;23(1):4-12
references.pmid: 12739254
references.citation: BMJ. 2008 Feb 16;336(7640):384-7
references.pmid: 18276715
references.citation: Med Educ. 2008 Apr;42(4):364-73
references.pmid: 18338989
references.citation: Acad Med. 2014 Mar;89(3):511-6
references.pmid: 24448051
references.citation: Ann Intern Med. 2003 Mar 18;138(6):476-81
references.pmid: 12639081
references.citation: BMJ. 2003 Mar 8;326(7388):546-8
references.pmid: 12623920
references.citation: Adv Health Sci Educ Theory Pract. 2010 Dec;15(5):625-32
references.pmid: 20146096
references.citation: JAMA. 2009 Sep 23;302(12):1316-26
references.pmid: 19773567
references.citation: J Grad Med Educ. 2011 Dec;3(4):453-5
references.pmid: 23205189
references.citation: Adv Health Sci Educ Theory Pract. 1996 Jan;1(1):41-67
references.pmid: 24178994
references.citation: Adv Health Sci Educ Theory Pract. 2001;6(1):81-8
references.pmid: 11486141
references.citation: JAMA. 1993 Apr 7;269(13):1655-60
references.pmid: 8240483
references.citation: J Contin Educ Health Prof. 2013 Spring;33(2):89-98
references.pmid: 23775909