Computer adaptive testing improved accuracy and precision of scores over random item selection in a physical functioning item bank.
OBJECTIVE
Measuring physical functioning (PF) within and across postacute settings is critical for monitoring outcomes of rehabilitation; however, most current instruments lack sufficient breadth and feasibility for widespread use. Computer adaptive testing (CAT), in which item selection is tailored to the individual patient, holds promise for reducing response burden, yet maintaining measurement precision. We calibrated a PF item bank via item response theory (IRT), administered items with a post hoc CAT design, and determined whether CAT would improve accuracy and precision of score estimates over random item selection.


METHODS
1,041 adults were interviewed during postacute care rehabilitation episodes in either hospital or community settings. Responses for 124 PF items were calibrated using IRT methods to create a PF item bank. We examined the accuracy and precision of CAT-based scores compared to a random selection of items.


RESULTS
CAT-based scores had higher correlations with the IRT-criterion scores, especially with short tests, and resulted in narrower confidence intervals than scores based on a random selection of items; gains, as expected, were especially large for low and high performing adults.


CONCLUSIONS
The CAT design may have important precision and efficiency advantages for point-of-care functional assessment in rehabilitation practice settings.
Haley
Stephen M
SM
Department of Rehabilitation Sciences, Sargent College of Health and Rehabilitation Sciences, Boston University, 635 Commanwealth Ave, Boston, MA 02215, USA. smhaley@bu.edu
Ni
Pengsheng
P
Hambleton
Ronald K
RK
Slavin
Mary D
MD
Jette
Alan M
AM
D000203:Activities of Daily Living; D000293:Adolescent; D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D016001:Confidence Intervals; D005163:Factor Analysis, Statistical; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D017063:Outcome Assessment, Health Care / Q000379:methods*; D020127:Recovery of Function; D012046:Rehabilitation / Q000592:standards*; D015203:Reproducibility of Results; D012984:Software