title: Relative precision, efficiency and construct validity of different starting and stopping rules for a computerized adaptive test: the GAIN substance problem scale.
abstract: Substance abuse treatment programs are being pressed to measure and make clinical decisions more efficiently about an increasing array of problems. This computerized adaptive testing (CAT) simulation examined the relative efficiency, precision and construct validity of different starting and stopping rules used to shorten the Global Appraisal of Individual Needs' (GAIN) Substance Problem Scale (SPS) and facilitate diagnosis based on it. Data came from 1,048 adolescents and adults referred to substance abuse treatment centers in 5 sites. CAT performance was evaluated using: (1) average standard errors, (2) average number of items, (3) bias in person measures, (4) root mean squared error of person measures, (5) Cohen's kappa to evaluate CAT classification compared to clinical classification, (6) correlation between CAT and full-scale measures, and (7) construct validity of CAT classification vs. clinical classification using correlations with five theoretically associated instruments. Results supported both CAT efficiency and validity.
authors.affiliation: Department of Disability and Human Development, M/C 626, University of Illinois at Chicago, 1640 W. Roosevelt Rd., Chicago, IL 60608, USA. barthr@uic.edu
authors.forename: Barth B
authors.initials: BB
authors.lastname: Riley
authors.forename: Kendon J
authors.initials: KJ
authors.lastname: Conrad
authors.forename: Nikolaus
authors.initials: N
authors.lastname: Bezruczko
authors.forename: Michael L
authors.initials: ML
authors.lastname: Dennis
mesh_terms: D000293:Adolescent; D003936:Diagnosis, Computer-Assisted; D005260:Female; D006801:Humans; D008297:Male; D008960:Models, Psychological; D019966:Substance-Related Disorders / Q000175:diagnosis*; D011795:Surveys and Questionnaires