title: Development and Assessment of Discrimination Exercises for Faculty Calibration in Preclinical Operative Dentistry.
abstract: The aims of this study were to identify the level of interexaminer agreement among preclinical operative dentistry faculty members when grading Class II preparations performed by first-year dental students; to develop discrimination exercises for specific preparation components where interexaminer agreement was poor; and to evaluate if the discrimination exercises were able to improve inter- and intraexaminer agreement. In the preliminary phase of this study, 13 components of 32 Class II cavity preparations were assessed by eight course faculty members at one U.S. dental school. Analysis of average interexaminer agreement on these components revealed that six were below 60%. These were proximal contact clearance, retention groove placement, retention groove depth, preparation walls, preparation margins, and preparation toilet/debris. A 30-minute calibration session was subsequently developed to provide discrimination exercises utilizing 3-D models and digital images of various levels of student performance for five of the six components. Immediately following calibration, the course faculty assessed the same 32 preparations (Phase I) followed by a delayed assessment without calibration (Phase II) approximately six months later. The results showed that overall interexaminer reliability improved after calibration. Although there was a decline in interexaminer reliability after an interval of six months (Phase II), the degree of variation among examiners was lower than in the preliminary assessment. These findings support the use of discrimination exercises for preclinical operative dentistry course faculty to increase interexaminer agreement and thereby improve the consistency of faculty-student communication.
authors.affiliation: Dr. Ahmed is Assistant Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Dr. Sturdevant is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Prof. Wilder is Professor, Department of Dental Ecology, University of North Carolina at Chapel Hill School of Dentistry; Dr. Kowlowitz is Evaluation, Teaching, and Learning Consult, University of North Carolina at Chapel Hill School of Dentistry and School of Nursing; and Dr. Boushell is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry. sumitha_ahmed@unc.edu.
authors.forename: Sumitha N
authors.initials: SN
authors.lastname: Ahmed
authors.affiliation: Dr. Ahmed is Assistant Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Dr. Sturdevant is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Prof. Wilder is Professor, Department of Dental Ecology, University of North Carolina at Chapel Hill School of Dentistry; Dr. Kowlowitz is Evaluation, Teaching, and Learning Consult, University of North Carolina at Chapel Hill School of Dentistry and School of Nursing; and Dr. Boushell is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry.
authors.forename: John
authors.initials: J
authors.lastname: Sturdevant
authors.affiliation: Dr. Ahmed is Assistant Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Dr. Sturdevant is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Prof. Wilder is Professor, Department of Dental Ecology, University of North Carolina at Chapel Hill School of Dentistry; Dr. Kowlowitz is Evaluation, Teaching, and Learning Consult, University of North Carolina at Chapel Hill School of Dentistry and School of Nursing; and Dr. Boushell is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry.
authors.forename: Rebecca
authors.initials: R
authors.lastname: Wilder
authors.affiliation: Dr. Ahmed is Assistant Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Dr. Sturdevant is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Prof. Wilder is Professor, Department of Dental Ecology, University of North Carolina at Chapel Hill School of Dentistry; Dr. Kowlowitz is Evaluation, Teaching, and Learning Consult, University of North Carolina at Chapel Hill School of Dentistry and School of Nursing; and Dr. Boushell is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry.
authors.forename: Vicki
authors.initials: V
authors.lastname: Kowlowitz
authors.affiliation: Dr. Ahmed is Assistant Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Dr. Sturdevant is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry; Prof. Wilder is Professor, Department of Dental Ecology, University of North Carolina at Chapel Hill School of Dentistry; Dr. Kowlowitz is Evaluation, Teaching, and Learning Consult, University of North Carolina at Chapel Hill School of Dentistry and School of Nursing; and Dr. Boushell is Associate Professor, Department of Operative Dentistry, University of North Carolina at Chapel Hill School of Dentistry.
authors.forename: Lee
authors.initials: L
authors.lastname: Boushell
mesh_terms: D003814:Dentistry, Operative / Q000193:education* / Q000592:standards; D004521:Educational Measurement / Q000379:methods / Q000592:standards*; D005179:Faculty, Dental / Q000592:standards*; D006801:Humans; D015588:Observer Variation; D015203:Reproducibility of Results; D013335:Students, Dental
keywords: calibration; dental education; faculty calibration; interexaminer reliability; intraexaminer reliability; operative dentistry