A comparison of three strategies for scale construction to predict a specific behavioral outcome.
Using 65 items from a mental health screening questionnaire, the History Opinion Inventory-Revised (HOI-R), the present study compared three strategies of scale construction-(1) internal (based on factor analysis), (2) external (based on empirical performance) and (3) intuitive (based on clinicians' opinion)-to predict whether 203,595 U.S. Air Force trainees would be discharged early for mental health or behavior-related reasons within a 4-year follow-up period. The external strategy significantly outperformed the internal strategy, which in turn outperformed the intuitive strategy. For all strategies, predictive accuracy was consistently higher when items and scales were scored using empirically derived weights rather than unit weights. These findings suggest that the external strategy of scale construction provides the highest accuracy when sample sizes are large and the aim is to predict a specific behavioral event. However, the internal strategy also yields valid results and can be a reasonable choice when outcome data are unavailable.
Garb
Howard N
HN
Lackland Air Force Base, San Antonio, TX 78236, USA. howard.garb@us.af.mil
Wood
James M
JM
Fiedler
Edna R
ER
D000293:Adolescent; D000328:Adult; D001519:Behavior; D005163:Factor Analysis, Statistical; D005260:Female; D006801:Humans; D016015:Logistic Models; D008297:Male; D001523:Mental Disorders / Q000175:diagnosis*; D008603:Mental Health; D008889:Military Personnel / Q000523:psychology* / Q000706:statistics & numerical data; D011569:Psychiatric Status Rating Scales / Q000592:standards* / Q000706:statistics & numerical data; D011594:Psychometrics / Q000379:methods* / Q000592:standards; D013781:Texas; D014481:United States; D055815:Young Adult