title: Confirmatory Factor Analysis of the System for Evaluation of Teaching Qualities (SETQ) in Graduate Medical Training.
abstract: The System for Evaluation of Teaching Qualities (SETQ) was developed as a formative system for the continuous evaluation and development of physicians' teaching performance in graduate medical training. It has been seven years since the introduction and initial exploratory psychometric analysis of the SETQ questionnaires. This study investigates the validity and reliability of the SETQ questionnaires across hospitals and medical specialties using confirmatory factor analyses (CFAs), reliability analysis, and generalizability analysis. The SETQ questionnaires were tested in a sample of 3,025 physicians and 2,848 trainees in 46 hospitals. The CFA revealed acceptable fit of the data to the previously identified five-factor model. The high internal consistency estimates suggest satisfactory reliability of the subscales. These results provide robust evidence for the validity and reliability of the SETQ questionnaires for evaluating physicians' teaching performance.
authors.affiliation: Professional Performance research group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands b.c.boerebach@amc.uva.nl.
authors.forename: Benjamin C M
authors.initials: BC
authors.lastname: Boerebach
authors.affiliation: Professional Performance research group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.
authors.forename: Kiki M J M H
authors.initials: KM
authors.lastname: Lombarts
authors.affiliation: Department of Epidemiology, University of California, Los Angeles (UCLA), School of Public Health, Los Angeles, CA, USA UCLA Center for Health Policy Research, Los Angeles, CA, USA.
authors.forename: Onyebuchi A
authors.initials: OA
authors.lastname: Arah
mesh_terms: D004503:Education, Medical, Graduate / Q000592:standards*; D005163:Factor Analysis, Statistical; D005180:Faculty, Medical / Q000193:education* / Q000592:standards*; D000068156:Formative Feedback; D006784:Hospitals, Teaching / Q000592:standards*; D006801:Humans; D009426:Netherlands; D011361:Professional Competence; D015397:Program Evaluation; D011594:Psychometrics; D015203:Reproducibility of Results
keywords: confirmatory factor analysis; feedback; physicians; postgraduate medical education; teaching performance; trainees