title: Dental anatomy grading: comparison between conventional visual and a novel digital assessment technique.
abstract: Conventional grading of dental students' projects in preclinical courses has mainly relied on visual evaluation by experienced instructors. The purpose of this study was to compare conventional visual grading in a dental anatomy course at one U.S. dental school to a novel digital assessment technique. A total of sixty samples comprised of two sets of faculty wax-ups (n=30), student wax-ups (n=15), and dentoform teeth of tooth #14 (n=15) were used for this study. Two additional faculty members visually graded the samples according to a checklist and then repeated the grading after one week. The sample wax-up with the highest score based on the visual grading was selected as the master model for the digital grading, which was also performed twice with an interim period of one week. Descriptive statistics and signed rank tests for systematic bias were used for intra- and interrater comparisons. The intraclass correlation (ICC) was used as a measure of intra- and interrater reliability. None of the faculty members achieved the minimum acceptable intrarater agreement of 0.8. Interrater agreement was substantially less than intrarater agreement for the visual grading, whereas all measures of intrarater agreement were greater than 0.9 and considered excellent for the digital assessment technique. These results suggest that visual grading is limited by modest intrarater reliability and low interrater agreement. Digital grading is a promising evaluation method showing excellent intrarater reliability and correlation. Correlation for visual and digital grading was consistently modest, partly supporting the potential use of digital technology in dental anatomy grading.
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics. soran-kwon@uiowa.edu.
authors.forename: So Ran
authors.initials: SR
authors.lastname: Kwon
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics.
authors.forename: Natalia
authors.initials: N
authors.lastname: Restrepo-Kennedy
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics.
authors.forename: Deborah V
authors.initials: DV
authors.lastname: Dawson
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics.
authors.forename: Marcela
authors.initials: M
authors.lastname: Hernandez
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics.
authors.forename: Gerald
authors.initials: G
authors.lastname: Denehy
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics.
authors.forename: Derek
authors.initials: D
authors.lastname: Blanchette
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics.
authors.forename: David G
authors.initials: DG
authors.lastname: Gratton
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics.
authors.forename: Steven A
authors.initials: SA
authors.lastname: Aquilino
authors.affiliation: Dr. Kwon is Associate Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Restrepo-Kennedy is Assistant Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Dawson is Professor and Director, Division of Biostatistics and Research Design, Department of Pediatric Dentistry and Biostatistics, and Interdisciplinary Programs in Genetics and in Informatics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Hernandez is Associate Professor, Department of Family Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Dr. Denehy is Professor, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics; Mr. Blanchette is Biostatistician, Division of Biostatistics and Research Design, The University of Iowa College of Dentistry & Dental Clinics; Dr. Gratton is Associate Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; Dr. Aquilino is Professor, Department of Prosthodontics, The University of Iowa College of Dentistry & Dental Clinics; and Dr. Armstrong is Professor and Chair, Department of Operative Dentistry, The University of Iowa College of Dentistry & Dental Clinics.
authors.forename: Steven R
authors.initials: SR
authors.lastname: Armstrong
mesh_terms: D000715:Anatomy / Q000193:education*; D015982:Bias; D002138:Calibration; D057189:Checklist; D004497:Education, Dental; D004521:Educational Measurement / Q000379:methods* / Q000592:standards; D018961:Educational Technology; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000379:methods; D021621:Imaging, Three-Dimensional / Q000379:methods; D007834:Lasers; D008838:Microcomputers; D003765:Models, Dental; D008963:Molar / Q000033:anatomy & histology; D015588:Observer Variation; D015203:Reproducibility of Results
keywords: assessment; dental anatomy; dental education; educational technology