Strategies for controlling item exposure in computerized adaptive testing with the partial credit model.
Exposure control research with polytomous item pools has determined that randomization procedures can be very effective for controlling test security in computerized adaptive testing (CAT). The current study investigated the performance of four procedures for controlling item exposure in a CAT under the partial credit model. In addition to a no exposure control baseline condition, the Kingsbury-Zara, modified-within-.10-logits, Sympson-Hetter, and conditional Sympson-Hetter procedures were implemented to control exposure rates. The Kingsbury-Zara and the modified-within-.10-logits procedures were implemented with 3 and 6 item candidate conditions. The results show that the Kingsbury-Zara and modified-within-.10-logits procedures with 6 item candidates performed as well as the conditional Sympson-Hetter in terms of exposure rates, overlap rates, and pool utilization. These two procedures are strongly recommended for use with partial credit CATs due to their simplicity and strength of their results.
Davis
Laurie Laughlin
LL
Pearson, 400 Center Ridge Drive, Austin, TX 78753, USA. laurie.davis@pearson.com
Dodd
Barbara G
BG
D000465:Algorithms; D003201:Computers; D004521:Educational Measurement / Q000706:statistics & numerical data; D006801:Humans; D011795:Surveys and Questionnaires / Q000592:standards*; D014481:United States