title: Varying the valuating function and the presentable bank in computerized adaptive testing.
abstract: In computerized adaptive testing, the most commonly used valuating function is the Fisher information function. When the goal is to keep item bank security at a maximum, the valuating function that seems most convenient is the matching criterion, valuating the distance between the estimated trait level and the point where the maximum of the information function is located. Recently, it has been proposed not to keep the same valuating function constant for all the items in the test. In this study we expand the idea of combining the matching criterion with the Fisher information function. We also manipulate the number of strata into which the bank is divided. We find that the manipulation of the number of items administered with each function makes it possible to move from the pole of high accuracy and low security to the opposite pole. It is possible to greatly improve item bank security with much fewer losses in accuracy by selecting several items with the matching criterion. In general, it seems more appropriate not to stratify the bank.
authors.affiliation: Facultad de Psicología, Universidad Autónoma de Barcelona, 08193 Bellaterra, Barcelona, Spain. juanramon.barrada@uab.es
authors.forename: Juan Ramón
authors.initials: JR
authors.lastname: Barrada
authors.forename: Francisco José
authors.initials: FJ
authors.lastname: Abad
authors.forename: Julio
authors.initials: J
authors.lastname: Olea
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D003936:Diagnosis, Computer-Assisted / Q000706:statistics & numerical data*; D004521:Educational Measurement / Q000706:statistics & numerical data*; D006801:Humans; D007256:Information Systems / Q000706:statistics & numerical data*; D008037:Linguistics; D008432:Mathematical Computing; D008433:Mathematics; D011581:Psychological Tests / Q000706:statistics & numerical data*; D011594:Psychometrics / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D012984:Software; D011795:Surveys and Questionnaires