title: Exploring valid and reliable assessment methods for care management education.
abstract: Purpose It is assumed that the use of valid and reliable assessment methods can facilitate the development of medical residents' management and leadership competencies. To justify this assertion, the perceptions of an expert panel of health care leaders were explored on assessment methods used for evaluating care management (CM) development in Dutch residency programs. This paper aims to investigate how assessors and trainees value these methods and examine for any inherent benefits or shortcomings when they are applied in practice. Design/methodology/approach A Delphi survey was conducted among members of the platform for medical leadership in The Netherlands. This panel of experts was made up of clinical educators, practitioners and residents interested in CM education. Findings Of the respondents, 40 (55.6 per cent) and 31 (43 per cent) participated in the first and second rounds of the Delphi survey, respectively. The respondents agreed that assessment methods currently being used to measure residents' CM competencies were weak, though feasible for use in many residency programs. Multi-source feedback (MSF, 92.1 per cent), portfolio/e-portfolio (86.8 per cent) and knowledge testing (76.3 per cent) were identified as the most commonly known assessment methods with familiarity rates exceeding 75 per cent. Practical implications The findings suggested that an "assessment framework" comprising MSF, portfolios, individual process improvement projects or self-reflections and observations in clinical practice should be used to measure CM competencies in residents. Originality/value This study reaffirms the need for objective methods to assess CM skills in post-graduate medical education, as there was not a single assessment method that stood out as the best instrument.
authors.affiliation: Faculty of Medicine, Erasmus University , Rotterdam, The Netherlands.
authors.forename: Lokke
authors.initials: L
authors.lastname: Gennissen
authors.affiliation: Department of Educational Development and Research, Faculty of Health, Medicine and Life Sciences, University of Maastricht , Maastricht, The Netherlands.
authors.forename: Lorette
authors.initials: L
authors.lastname: Stammen
authors.affiliation: Platform for Medical Leadership, Den Haag, The Netherlands.
authors.forename: Jolien
authors.initials: J
authors.lastname: Bueno-de-Mesquita
authors.affiliation: Platform for Medical Leadership, Utrecht, The Netherlands.
authors.forename: Sietse
authors.initials: S
authors.lastname: Wieringa
authors.affiliation: Pediatric Residency Program, Department of Pediatrics, Zuyderland Medical Center , Heerlen, The Netherlands and Department of Educational Development and Research, Faculty of Health, Medicine and Life Sciences, University of Maastricht , Maastricht, The Netherlands.
authors.forename: Jamiu
authors.initials: J
authors.lastname: Busari
mesh_terms: D002983:Clinical Competence; D004503:Education, Medical, Graduate; D005246:Feedback; D006801:Humans; D007396:Internship and Residency; D009426:Netherlands
keywords: Care management; Competency; Health care; Medical education; Physician; Postgraduate