Fitting multilevel models in complex survey data with design weights: Recommendations.
BACKGROUND
Multilevel models (MLM) offer complex survey data analysts a unique approach to understanding individual and contextual determinants of public health. However, little summarized guidance exists with regard to fitting MLM in complex survey data with design weights. Simulation work suggests that analysts should scale design weights using two methods and fit the MLM using unweighted and scaled-weighted data. This article examines the performance of scaled-weighted and unweighted analyses across a variety of MLM and software programs.


METHODS
Using data from the 2005-2006 National Survey of Children with Special Health Care Needs (NS-CSHCN: n = 40,723) that collected data from children clustered within states, I examine the performance of scaling methods across outcome type (categorical vs. continuous), model type (level-1, level-2, or combined), and software (Mplus, MLwiN, and GLLAMM).


RESULTS
Scaled weighted estimates and standard errors differed slightly from unweighted analyses, agreeing more with each other than with unweighted analyses. However, observed differences were minimal and did not lead to different inferential conclusions. Likewise, results demonstrated minimal differences across software programs, increasing confidence in results and inferential conclusions independent of software choice.


CONCLUSIONS
If including design weights in MLM, analysts should scale the weights and use software that properly includes the scaled weights in the estimation.
Carle
Adam C
AC
Department of Psychology, University of North Florida, Jacksonville, FL 32224, USA. adam.carle@unf.edu
D002648:Child; D003266:Continuity of Patient Care; D003695:Delivery of Health Care; D019538:Health Care Surveys; D006291:Health Policy; D006297:Health Services Accessibility; D006306:Health Surveys; D006801:Humans; D055361:Multilevel Analysis; D015999:Multivariate Analysis; D017063:Outcome Assessment, Health Care; D010818:Practice Patterns, Physicians'; D011787:Quality of Health Care; D016032:Randomized Controlled Trials as Topic; D012050:Rehabilitation, Vocational; D012572:School Health Services; D012959:Socioeconomic Factors; D012984:Software; D011795:Surveys and Questionnaires