[Using the SETQ system to evaluate and improve teaching qualities of clinical teachers].
OBJECTIVE
To determine (a) the feasibility of implementing a system for the evaluation of teaching qualities (SETQ) of faculty in an academic medical centre, (b) the psychometric qualities of the questionnaires that are used for the generation of feedback and (c) how residents evaluate the teaching qualities of faculty members and how faculty rated themselves.


METHODS
Questionnaire study.


METHODS
Residents evaluated the teaching qualities of faculty members and faculty also evaluated themselves. Specialty specific questionnaires were developed for both evaluations. The psychometric qualities of the questionnaires were determined by using exploratory factor analysis and by calculating the reliability coefficients of scale constructs and item-total correlation. Mean, median and range were calculated for all teaching aspects per training programme.


RESULTS
In the course of one year, 16 residency programmes in our academic medical centre implemented the SETQ system for the evaluation of teaching faculty. 398 faculty members and 314 residents were invited to (self-) evaluate; the response rates were 80.9% and 73.6% respectively. Residents conducted 2,520 evaluations in total. Factor analysis resulted in the definition of 5 teaching domains: 'learning climate', 'professional attitude towards residents', 'communication of learning goals', 'evaluation of residents' and 'feedback to residents'. Item-total correlation and reliability were high for both the residents' questionnaire and the self-evaluation questionnaire (Cronbach's alpha: > 0.70), except for the educational aspect 'learning climate' on the self-evaluation questionnaire (alpha: 0.67) Faculty members were rated positively, but the self-evaluation of faculty members was slightly less positive. For both groups 'professional attitude towards residents' was the highest scoring teaching domain and 'communication of learning goals' the lowest one.


CONCLUSIONS
Implementing a system for the evaluation of teaching qualities (SETQ) of faculty in an academic hospital was proven feasible. The psychometric qualities of the underlying instruments was sufficient to good. Teaching faculty were evaluated positively, although interdepartmental variations existed.
Lombarts
M J M H Kiki
MJ
Academisch Medisch Centrum, Afd. Kwaliteit en Proces Innovatie, Amsterdam, The Netherlands. m.j.lombarts@amc.uva.nl
Arah
Onyebuchi A
OA
Busch
Olivier R C
OR
Heineman
Maas Jan
MJ
D002983:Clinical Competence; D003625:Data Collection; D005163:Factor Analysis, Statistical; D005180:Faculty, Medical / Q000592:standards*; D006784:Hospitals, Teaching; D006801:Humans; D007396:Internship and Residency; D009426:Netherlands; D015397:Program Evaluation; D013192:Staff Development / Q000379:methods / Q000592:standards*; D011795:Surveys and Questionnaires; D013663:Teaching / Q000379:methods* / Q000592:standards*; D000078329:Workforce