Psychometric Evaluation of a 13-Point Measure of Students' Overall Competence in Community-Based Dental Education Programs.
Since 2006, the University of Michigan School of Dentistry has used a 13-point measure of overall competence instrument to assess fourth-year dental students' end-rotation performance at community clinics. The aim of this study was to assess the reliability and validity of this instrument used by preceptors to rate students' overall competence during community-based dental education experiences. The measure was analyzed using performance ratings for all fourth-year DDS students in the graduating classes of 2012 and 2013 (combined n=201). The results were that interrater agreement was satisfactory and the measure scored high for internal consistency; also, the measure loaded highly on a single overall competence factor. Ratings on this measure did not correlate with students' final cumulative dental school GPA, but showed a significant positive correlation with their fourth-year fall patient management grades (which signify students' conscientiousness in managing patients and their families in a professional and ethical manner). There were differences in grading systems between the 2012 cohort (which used a pass/fail system) and the 2013 cohort (which used a letter grade system) and the mean ratings they received (higher for the 2013 cohort). Overall, the study found that the 13-point measure demonstrated excellent reliability and validity, suggesting it is useful in determining a student's clinical competence in these settings.
Dr. Ramaswamy is Curriculum Assessment Specialist, School of Dentistry, University of Michigan; Dr. Piskorowski is Assistant Dean for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Fitzgerald is Associate Professor and Associate Chair, Cariology, Restorative Sciences, and Endodontics, School of Dentistry, University of Michigan; Dr. Hamerink is Adjunct Clinical Associate Professor, Biologic and Materialistic Sciences, Prosthodontic Section and Academic Program Manager for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Stefanac is Senior Associate Dean, School of Dentistry, University of Michigan; Dr. Greene is Regional Clinical Director of Western Washington, School of Dentistry, University of Washington; and Dr. Lantz is Professor Emerita and Associate Dean for Academic Affairs Emerita, School of Dentistry, University of Michigan. ramaswav@umich.edu.
Vidya
V
Ramaswamy
Dr. Ramaswamy is Curriculum Assessment Specialist, School of Dentistry, University of Michigan; Dr. Piskorowski is Assistant Dean for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Fitzgerald is Associate Professor and Associate Chair, Cariology, Restorative Sciences, and Endodontics, School of Dentistry, University of Michigan; Dr. Hamerink is Adjunct Clinical Associate Professor, Biologic and Materialistic Sciences, Prosthodontic Section and Academic Program Manager for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Stefanac is Senior Associate Dean, School of Dentistry, University of Michigan; Dr. Greene is Regional Clinical Director of Western Washington, School of Dentistry, University of Washington; and Dr. Lantz is Professor Emerita and Associate Dean for Academic Affairs Emerita, School of Dentistry, University of Michigan.
Wilhelm
W
Piskorowski
Dr. Ramaswamy is Curriculum Assessment Specialist, School of Dentistry, University of Michigan; Dr. Piskorowski is Assistant Dean for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Fitzgerald is Associate Professor and Associate Chair, Cariology, Restorative Sciences, and Endodontics, School of Dentistry, University of Michigan; Dr. Hamerink is Adjunct Clinical Associate Professor, Biologic and Materialistic Sciences, Prosthodontic Section and Academic Program Manager for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Stefanac is Senior Associate Dean, School of Dentistry, University of Michigan; Dr. Greene is Regional Clinical Director of Western Washington, School of Dentistry, University of Washington; and Dr. Lantz is Professor Emerita and Associate Dean for Academic Affairs Emerita, School of Dentistry, University of Michigan.
Mark
M
Fitzgerald
Dr. Ramaswamy is Curriculum Assessment Specialist, School of Dentistry, University of Michigan; Dr. Piskorowski is Assistant Dean for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Fitzgerald is Associate Professor and Associate Chair, Cariology, Restorative Sciences, and Endodontics, School of Dentistry, University of Michigan; Dr. Hamerink is Adjunct Clinical Associate Professor, Biologic and Materialistic Sciences, Prosthodontic Section and Academic Program Manager for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Stefanac is Senior Associate Dean, School of Dentistry, University of Michigan; Dr. Greene is Regional Clinical Director of Western Washington, School of Dentistry, University of Washington; and Dr. Lantz is Professor Emerita and Associate Dean for Academic Affairs Emerita, School of Dentistry, University of Michigan.
Howard A
HA
Hamerink
Dr. Ramaswamy is Curriculum Assessment Specialist, School of Dentistry, University of Michigan; Dr. Piskorowski is Assistant Dean for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Fitzgerald is Associate Professor and Associate Chair, Cariology, Restorative Sciences, and Endodontics, School of Dentistry, University of Michigan; Dr. Hamerink is Adjunct Clinical Associate Professor, Biologic and Materialistic Sciences, Prosthodontic Section and Academic Program Manager for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Stefanac is Senior Associate Dean, School of Dentistry, University of Michigan; Dr. Greene is Regional Clinical Director of Western Washington, School of Dentistry, University of Washington; and Dr. Lantz is Professor Emerita and Associate Dean for Academic Affairs Emerita, School of Dentistry, University of Michigan.
Stephen
S
Stefanac
Dr. Ramaswamy is Curriculum Assessment Specialist, School of Dentistry, University of Michigan; Dr. Piskorowski is Assistant Dean for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Fitzgerald is Associate Professor and Associate Chair, Cariology, Restorative Sciences, and Endodontics, School of Dentistry, University of Michigan; Dr. Hamerink is Adjunct Clinical Associate Professor, Biologic and Materialistic Sciences, Prosthodontic Section and Academic Program Manager for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Stefanac is Senior Associate Dean, School of Dentistry, University of Michigan; Dr. Greene is Regional Clinical Director of Western Washington, School of Dentistry, University of Washington; and Dr. Lantz is Professor Emerita and Associate Dean for Academic Affairs Emerita, School of Dentistry, University of Michigan.
Rachel
R
Greene
Dr. Ramaswamy is Curriculum Assessment Specialist, School of Dentistry, University of Michigan; Dr. Piskorowski is Assistant Dean for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Fitzgerald is Associate Professor and Associate Chair, Cariology, Restorative Sciences, and Endodontics, School of Dentistry, University of Michigan; Dr. Hamerink is Adjunct Clinical Associate Professor, Biologic and Materialistic Sciences, Prosthodontic Section and Academic Program Manager for Community-Based Dental Education, School of Dentistry, University of Michigan; Dr. Stefanac is Senior Associate Dean, School of Dentistry, University of Michigan; Dr. Greene is Regional Clinical Director of Western Washington, School of Dentistry, University of Washington; and Dr. Lantz is Professor Emerita and Associate Dean for Academic Affairs Emerita, School of Dentistry, University of Michigan.
Marilyn S
MS
Lantz
D002983:Clinical Competence / Q000706:statistics & numerical data; D003149:Community Dentistry / Q000193:education*; D004497:Education, Dental; D008824:Michigan; D011594:Psychometrics
assessment; clinical competence; community rotations; community-based dental education; dental education