title: Three Modeling Applications to Promote Automatic Item Generation for Examinations in Dentistry.
abstract: Test items created for dentistry examinations are often individually written by content experts. This approach to item development is expensive because it requires the time and effort of many content experts but yields relatively few items. The aim of this study was to describe and illustrate how items can be generated using a systematic approach. Automatic item generation (AIG) is an alternative method that allows a small number of content experts to produce large numbers of items by integrating their domain expertise with computer technology. This article describes and illustrates how three modeling approaches to item content-item cloning, cognitive modeling, and image-anchored modeling-can be used to generate large numbers of multiple-choice test items for examinations in dentistry. Test items can be generated by combining the expertise of two content specialists with technology supported by AIG. A total of 5,467 new items were created during this study. From substitution of item content, to modeling appropriate responses based upon a cognitive model of correct responses, to generating items linked to specific graphical findings, AIG has the potential for meeting increasing demands for test items. Further, the methods described in this study can be generalized and applied to many other item types. Future research applications for AIG in dental education are discussed.
authors.affiliation: Dr. Lai is Assistant Professor, University of Alberta School of Dentistry; Dr. Gierl is Professor and Canada Research Chair in Educational Measurement, University of Alberta Faculty of Education; Dr. Byrne is Professor of Endodontics and Senior Associate Dean, Virginia Commonwealth University School of Dentistry; Dr. Spielman is Professor and Associate Dean for Academic Affairs, New York University College of Dentistry; and Dr. Waldschmidt is Director of Testing Services, American Dental Association and Secretary of the Joint Commission on National Dental Examinations. hollis.lai@ualberta.ca.
authors.forename: Hollis
authors.initials: H
authors.lastname: Lai
authors.affiliation: Dr. Lai is Assistant Professor, University of Alberta School of Dentistry; Dr. Gierl is Professor and Canada Research Chair in Educational Measurement, University of Alberta Faculty of Education; Dr. Byrne is Professor of Endodontics and Senior Associate Dean, Virginia Commonwealth University School of Dentistry; Dr. Spielman is Professor and Associate Dean for Academic Affairs, New York University College of Dentistry; and Dr. Waldschmidt is Director of Testing Services, American Dental Association and Secretary of the Joint Commission on National Dental Examinations.
authors.forename: Mark J
authors.initials: MJ
authors.lastname: Gierl
authors.affiliation: Dr. Lai is Assistant Professor, University of Alberta School of Dentistry; Dr. Gierl is Professor and Canada Research Chair in Educational Measurement, University of Alberta Faculty of Education; Dr. Byrne is Professor of Endodontics and Senior Associate Dean, Virginia Commonwealth University School of Dentistry; Dr. Spielman is Professor and Associate Dean for Academic Affairs, New York University College of Dentistry; and Dr. Waldschmidt is Director of Testing Services, American Dental Association and Secretary of the Joint Commission on National Dental Examinations.
authors.forename: B Ellen
authors.initials: BE
authors.lastname: Byrne
authors.affiliation: Dr. Lai is Assistant Professor, University of Alberta School of Dentistry; Dr. Gierl is Professor and Canada Research Chair in Educational Measurement, University of Alberta Faculty of Education; Dr. Byrne is Professor of Endodontics and Senior Associate Dean, Virginia Commonwealth University School of Dentistry; Dr. Spielman is Professor and Associate Dean for Academic Affairs, New York University College of Dentistry; and Dr. Waldschmidt is Director of Testing Services, American Dental Association and Secretary of the Joint Commission on National Dental Examinations.
authors.forename: Andrew I
authors.initials: AI
authors.lastname: Spielman
authors.affiliation: Dr. Lai is Assistant Professor, University of Alberta School of Dentistry; Dr. Gierl is Professor and Canada Research Chair in Educational Measurement, University of Alberta Faculty of Education; Dr. Byrne is Professor of Endodontics and Senior Associate Dean, Virginia Commonwealth University School of Dentistry; Dr. Spielman is Professor and Associate Dean for Academic Affairs, New York University College of Dentistry; and Dr. Waldschmidt is Director of Testing Services, American Dental Association and Secretary of the Joint Commission on National Dental Examinations.
authors.forename: David M
authors.initials: DM
authors.lastname: Waldschmidt
mesh_terms: D000465:Algorithms; D000900:Anti-Bacterial Agents / Q000627:therapeutic use; D002983:Clinical Competence; D003071:Cognition; D003162:Competency-Based Education; D003205:Computing Methodologies; D004497:Education, Dental; D004521:Educational Measurement / Q000379:methods* / Q000592:standards; D006801:Humans; D017145:Models, Educational; D011340:Problem Solving; D011862:Radiography, Panoramic; D011871:Radiology / Q000193:education
chemical_list: D000900:Anti-Bacterial Agents
keywords: assessment; dental education; item generation; item writing; test development