title: Inter- and Intrarater Reliability Using Different Software Versions of E4D Compare in Dental Education.
abstract: The problems associated with intra- and interexaminer reliability when assessing preclinical performance continue to hinder dental educators' ability to provide accurate and meaningful feedback to students. Many studies have been conducted to evaluate the validity of utilizing various technologies to assist educators in achieving that goal. The purpose of this study was to compare two different versions of E4D Compare software to determine if either could be expected to deliver consistent and reliable comparative results, independent of the individual utilizing the technology. Five faculty members obtained E4D digital images of students' attempts (sample model) at ideal gold crown preparations for tooth #30 performed on typodont teeth. These images were compared to an ideal (master model) preparation utilizing two versions of E4D Compare software. The percent correlations between and within these faculty members were recorded and averaged. The intraclass correlation coefficient was used to measure both inter- and intrarater agreement among the examiners. The study found that using the older version of E4D Compare did not result in acceptable intra- or interrater agreement among the examiners. However, the newer version of E4D Compare, when combined with the Nevo scanner, resulted in a remarkable degree of agreement both between and within the examiners. These results suggest that consistent and reliable results can be expected when utilizing this technology under the protocol described in this study.
authors.affiliation: Dr. Callan is Associate Professor and Chair, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Cooper is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Young is Instructor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Mollica is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Furness is Assistant Professor, Department of Oral Rehabilitation, College of Dental Medicine, Georgia Regents University; and Dr. Looney is Professor, Department of Biostatistics and Epidemiology, Medical College of Georgia, Georgia Regents University. rcallan@gru.edu.
authors.forename: Richard S
authors.initials: RS
authors.lastname: Callan
authors.affiliation: Dr. Callan is Associate Professor and Chair, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Cooper is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Young is Instructor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Mollica is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Furness is Assistant Professor, Department of Oral Rehabilitation, College of Dental Medicine, Georgia Regents University; and Dr. Looney is Professor, Department of Biostatistics and Epidemiology, Medical College of Georgia, Georgia Regents University.
authors.forename: Jeril R
authors.initials: JR
authors.lastname: Cooper
authors.affiliation: Dr. Callan is Associate Professor and Chair, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Cooper is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Young is Instructor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Mollica is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Furness is Assistant Professor, Department of Oral Rehabilitation, College of Dental Medicine, Georgia Regents University; and Dr. Looney is Professor, Department of Biostatistics and Epidemiology, Medical College of Georgia, Georgia Regents University.
authors.forename: Nancy B
authors.initials: NB
authors.lastname: Young
authors.affiliation: Dr. Callan is Associate Professor and Chair, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Cooper is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Young is Instructor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Mollica is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Furness is Assistant Professor, Department of Oral Rehabilitation, College of Dental Medicine, Georgia Regents University; and Dr. Looney is Professor, Department of Biostatistics and Epidemiology, Medical College of Georgia, Georgia Regents University.
authors.forename: Anthony G
authors.initials: AG
authors.lastname: Mollica
authors.affiliation: Dr. Callan is Associate Professor and Chair, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Cooper is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Young is Instructor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Mollica is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Furness is Assistant Professor, Department of Oral Rehabilitation, College of Dental Medicine, Georgia Regents University; and Dr. Looney is Professor, Department of Biostatistics and Epidemiology, Medical College of Georgia, Georgia Regents University.
authors.forename: Alan R
authors.initials: AR
authors.lastname: Furness
authors.affiliation: Dr. Callan is Associate Professor and Chair, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Cooper is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Young is Instructor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Mollica is Assistant Professor, Department of General Dentistry, College of Dental Medicine, Georgia Regents University; Dr. Furness is Assistant Professor, Department of Oral Rehabilitation, College of Dental Medicine, Georgia Regents University; and Dr. Looney is Professor, Department of Biostatistics and Epidemiology, Medical College of Georgia, Georgia Regents University.
authors.forename: Stephen W
authors.initials: SW
authors.lastname: Looney
mesh_terms: D017076:Computer-Aided Design / Q000295:instrumentation; D003442:Crowns / Q000592:standards; D003814:Dentistry, Operative / Q000193:education; D004497:Education, Dental; D004521:Educational Measurement / Q000379:methods*; D018961:Educational Technology; D005179:Faculty, Dental / Q000592:standards*; D005246:Feedback; D006801:Humans; D015203:Reproducibility of Results; D012655:Self-Evaluation Programs; D012984:Software; D019231:Tooth Preparation, Prosthodontic / Q000592:standards
keywords: CAD/CAM; assessment; dental education; grading; interrater reliability; intrarater reliability