Measuring teaching effectiveness in a pre-clinical multi-instructor course: a case study in the development and application of a brief instructor rating scale.
BACKGROUND
Despite widespread use, misunderstandings persist about student evaluations of teaching. These evaluations have not been well examined in the common medical school setting of the multi-instructor, preclinical lecture course.


OBJECTIVE
The study evaluated the psychometrics of a brief student evaluation of a teaching instrument developed for a multi-instructor 2nd-year course and described its application.


METHODS
An 11-item instrument was developed and administered to 276 students to evaluate 27 lecturers per year in 3 years of an introductory clinical psychiatry course. A fully crossed research design allowed for a thorough analysis of variability in ratings.


RESULTS
Generalizability analysis showed good reliability and relatively large Student x Lecturer interactions. Profile analysis generated distinct lecturer teaching profiles.


CONCLUSIONS
Judicious use of a psychometrically sound student evaluation of a teaching instrument can be used to assist faculty and course development. Administering the evaluation instrument to an entire class produces no better reliability than administration to randomly selected subgroups of students.
Leamon
Martin H
MH
Department of Psychiatry, University of California, Davis School of Medicine, Sacramento, California 95817, USA. mhleamon@ucdavis.edu
Fields
Laurie
L
D004504:Education, Medical, Undergraduate; D005069:Evaluation Studies as Topic; D005163:Factor Analysis, Statistical; D006801:Humans; D011594:Psychometrics; D015203:Reproducibility of Results; D013337:Students, Medical; D013663:Teaching / Q000706:statistics & numerical data*; D014481:United States