Assessment of CanMEDS roles in postgraduate training: the validation of the Compass.
OBJECTIVE
In medical education the focus has shifted from gaining knowledge to developing competencies. To effectively monitor performance in practice throughout the entire training, a new approach of assessment is needed. This study aimed to evaluate an instrument that monitors the development of competencies during postgraduate training in the setting of training of general practice: the Competency Assessment List (Compass).


METHODS
The distribution of scores, reliability, validity, responsiveness and feasibility of the Compass were evaluated.


RESULTS
Scores of the Compass ranged from 1 to 9 on a 10-point scale, showing excellent internal consistency ranging from .89 to .94. Most trainees showed improving ratings during training. Medium to large effect sizes (.31-1.41) were demonstrated when we compared mean scores of three consecutive periods. Content validity of the Compass was supported by the results of a qualitative study using the RAND modified Delphi Method. The feasibility of the Compass was demonstrated.


CONCLUSIONS
The Compass is a competency based instrument that shows in a reliable and valid way trainees' progress towards the standard of performance.


CONCLUSIONS
The programmatic approach of the Compass could be applied in other specialties provided that the instrument is tailored to specific needs of that specialism.
Department of Primary and Community Care, Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands. F.Tromp@elg.umcn.nl
Fred
F
Tromp
Myrra
M
Vernooij-Dassen
Richard
R
Grol
Anneke
A
Kramer
Ben
B
Bottema
D002983:Clinical Competence / Q000592:standards*; D003162:Competency-Based Education / Q000379:methods*; D004503:Education, Medical, Graduate / Q000379:methods*; D005240:Feasibility Studies; D058006:General Practice / Q000193:education*; D006801:Humans; D009426:Netherlands; D010820:Physicians; D011594:Psychometrics; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires