title: Generalizability analyses of NBDE Part II.
abstract: This research applied generalizability theory to assess the effect of varying the number of cases and items nested within cases on generalizability of scores on Part II of the National Board Dental Examinations (NBDE Part II). In this research, sources of error were defined. Measurement conditions were classified. Error variances and generalizability coefficients for different conditions were computed. The data analyzed were the item responses of 1,535 candidates enrolled in accredited dental education programs who all took the same test form in 2007. Results showed that using more cases of fewer items might lead to a greater increase in generalizability than using more items per case. Other practical considerations such as time and cost constraints must be taken into account when applying the results of this research in other testing situations.
authors.affiliation: Department of Testing Services, American Dental Association, Chicago, IL 60611, USA. tsait@ada.org
authors.forename: Tsung-Hsun
authors.initials: TH
authors.lastname: Tsai
authors.forename: Chingwei David
authors.initials: CD
authors.lastname: Shin
authors.forename: Laura M
authors.initials: LM
authors.lastname: Neumann
authors.forename: Barry W
authors.initials: BW
authors.lastname: Grau
mesh_terms: D000704:Analysis of Variance; D002170:Canada; D003813:Dentistry / Q000592:standards* / Q000706:statistics & numerical data; D004497:Education, Dental / Q000592:standards* / Q000706:statistics & numerical data; D004521:Educational Measurement / Q000379:methods* / Q000592:standards / Q000706:statistics & numerical data; D006801:Humans; D015203:Reproducibility of Results; D012984:Software; D013044:Specialty Boards / Q000592:standards* / Q000706:statistics & numerical data