title: On initial item selection in cognitive diagnostic computerized adaptive testing.
abstract: There has recently been much interest in computerized adaptive testing (CAT) for cognitive diagnosis. While there exist various item selection criteria and different asymptotically optimal designs, these are mostly constructed based on the asymptotic theory assuming the test length goes to infinity. In practice, with limited test lengths, the desired asymptotic optimality may not always apply, and there are few studies in the literature concerning the optimal design of finite items. Related questions, such as how many items we need in order to be able to identify the attribute pattern of an examinee and what types of initial items provide the optimal classification results, are still open. This paper aims to answer these questions by providing non-asymptotic theory of the optimal selection of initial items in cognitive diagnostic CAT. In particular, for the optimal design, we provide necessary and sufficient conditions for the Q-matrix structure of the initial items. The theoretical development is suitable for a general family of cognitive diagnostic models. The results not only provide a guideline for the design of optimal item selection procedures, but also may be applied to guide item bank construction.
authors.affiliation: School of Statistics, University of Minnesota, Minneapolis, Minnesota, USA. xuxxx360@umn.edu.
authors.forename: Gongjun
authors.initials: G
authors.lastname: Xu
authors.affiliation: Department of Psychology, University of Minnesota, Minneapolis, Minnesota, USA.
authors.forename: Chun
authors.initials: C
authors.lastname: Wang
authors.affiliation: School of Statistics, University of Minnesota, Minneapolis, Minnesota, USA.
authors.forename: Zhuoran
authors.initials: Z
authors.lastname: Shang
mesh_terms: D000465:Algorithms; D003072:Cognition Disorders / Q000175:diagnosis*; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D003936:Diagnosis, Computer-Assisted / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D015233:Models, Statistical; D011594:Psychometrics / Q000379:methods; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D011795:Surveys and Questionnaires
keywords: Q-matrix; cognitive diagnosis; computerized adaptive testing; optimal item selection