title: Effects of ignoring clustered data structure in confirmatory factor analysis of ordered polytomous items: a simulation study based on PANSS.
abstract: Statistical theory indicates that hierarchical clustering by interviewers or raters needs to be considered to avoid incorrect inferences when performing any analyses including regression, factor analysis (FA) or item response theory (IRT) modelling of binary or ordinal data. We use simulated Positive and Negative Syndrome Scale (PANSS) data to show the consequences (in terms of bias, variance and mean square error) of using an analysis ignoring clustering on confirmatory factor analysis (CFA) estimates. Our investigation includes the performance of different estimators, such as maximum likelihood, weighted least squares and Markov Chain Monte Carlo (MCMC). Our simulation results suggest that ignoring clustering may lead to serious bias of the estimated factor loadings, item thresholds, and corresponding standard errors in CFAs for ordinal item response data typical of that commonly encountered in psychiatric research. In addition, fit indices tend to show a poor fit for the hypothesized structural model. MCMC estimation may be more robust against clustering than maximum likelihood and weighted least squares approaches but further investigation of these issues is warranted in future simulation studies of other datasets. Copyright © 2015 John Wiley & Sons, Ltd.
authors.affiliation: Department of Psychiatry, University of Cambridge, Cambridge, UK. jan.stochl@york.ac.uk.|Mental Health and Addiction Research Group (MHARG), Department of Health Sciences, University of York, York, UK. jan.stochl@york.ac.uk.|Department of Kinanthropology, Charles University in Prague, Prague, Czech Republic. jan.stochl@york.ac.uk.
authors.forename: Jan
authors.initials: J
authors.lastname: Stochl
authors.affiliation: Department of Psychiatry, University of Cambridge, Cambridge, UK.
authors.forename: Peter B
authors.initials: PB
authors.lastname: Jones
authors.affiliation: Department of Psychiatry, University of Cambridge, Cambridge, UK.
authors.forename: Jesus
authors.initials: J
authors.lastname: Perez
authors.affiliation: Department of Psychiatry, University of Cambridge, Cambridge, UK.
authors.forename: Golam M
authors.initials: GM
authors.lastname: Khandaker
authors.affiliation: Mental Health and Addiction Research Group (MHARG), Department of Health Sciences, University of York, York, UK.|Hull York Medical School (HYMS), University of York, York, UK.
authors.forename: Jan R
authors.initials: JR
authors.lastname: Böhnke
authors.affiliation: Department of Psychiatry, University of Cambridge, Cambridge, UK.|Social Dimensions of Health Institute and School of Nursing and Midwifery, University of Dundee, Dundee, UK.
authors.forename: Tim J
authors.initials: TJ
authors.lastname: Croudace
mesh_terms: D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D005163:Factor Analysis, Statistical; D006801:Humans; D011569:Psychiatric Status Rating Scales / Q000706:statistics & numerical data*
keywords: PANSS; factor analysis; hierarchical modelling; simulation