Predicting gender differences as latent variables: summed scores, and individual item responses: a methods case study.
BACKGROUND
Modeling latent variables such as physical disability is challenging since its measurement is performed through proxies. This poses significant methodological challenges. The objective of this article is to present three different methods to predict latent variables based on classical summed scores, individual item responses, and latent variable models.


METHODS
This is a review of the literature and data analysis using "layers of information". Data was collected from the North Carolina Back Pain Project, using a modified version of the Roland Questionnaire.


RESULTS
The three models are compared in relation to their goals and underlying concepts, previous clinical applications, data requirements, statistical theory, and practical applications. Initial linear regression models demonstrated a difference in disability between genders of 1.32 points (95% CI 0.65, 2.00) on a scale from 0-23. Subsequent item analysis found contradictory results across items, with no clear pattern. Finally, IRT models demonstrated three items were demonstrated to present differential item functioning. After these items were removed, the difference between genders was reduced to 0.78 points (95% CI, -0.99, 1.23). These results were shown to be robust with re-sampling methods.


CONCLUSIONS
Purported differences in the levels of a latent variable should be tested using different models to verify whether these differences are real or simply distorted by model assumptions.
Pietrobon
Ricardo
R
Division of Orthopaedic Surgery, Center for Excellence in Surgical Outcomes, Duke University Medical Center, Box 3094, Durham, NC 27710, USA. rpietro@duke.edu
Taylor
Marcus
M
Guller
Ulrich
U
Higgins
Laurence D
LD
Jacobs
Danny O
DO
Carey
Timothy
T
D001416:Back Pain / Q000503:physiopathology* / Q000523:psychology; D016001:Confidence Intervals; D003627:Data Interpretation, Statistical; D004185:Disability Evaluation; D005260:Female; D005544:Forecasting; D006801:Humans; D008297:Male; D015233:Models, Statistical; D009657:North Carolina; D017063:Outcome Assessment, Health Care / Q000379:methods* / Q000706:statistics & numerical data; D011336:Probability; D011594:Psychometrics / Q000379:methods; D012044:Regression Analysis; D012107:Research Design; D012737:Sex Factors; D018434:Sickness Impact Profile; D011795:Surveys and Questionnaires