title: Measuring depression over time . . . Or not? Lack of unidimensionality and longitudinal measurement invariance in four common rating scales of depression.
abstract: In depression research, symptoms are routinely assessed via rating scales and added to construct sum-scores. These scores are used as a proxy for depression severity in cross-sectional research, and differences in sum-scores over time are taken to reflect changes in an underlying depression construct. To allow for such interpretations, rating scales must (a) measure a single construct, and (b) measure that construct in the same way across time. These requirements are referred to as unidimensionality and measurement invariance. We investigated these 2 requirements in 2 large prospective studies (combined n = 3,509) in which overall depression levels decrease, examining 4 common depression rating scales (1 self-report, 3 clinician-report) with different time intervals between assessments (between 6 weeks and 2 years). A consistent pattern of results emerged. For all instruments, neither unidimensionality nor measurement invariance appeared remotely tenable. At least 3 factors were required to describe each scale, and the factor structure changed over time. Typically, the structure became less multifactorial as depression severity decreased (without however reaching unidimensionality). The decrease in the sum-scores was accompanied by an increase in the variances of the sum-scores, and increases in internal consistency. These findings challenge the common interpretation of sum-scores and their changes as reflecting 1 underlying construct. The violations of common measurement requirements are sufficiently severe to suggest alternative interpretations of depression sum-scores as formative instead of reflective measures. We discuss the possible causes of these violations such as response shift bias, restriction of range, and regression to the mean. (PsycINFO Database Record
authors.affiliation: Faculty of Psychology and Educational Sciences.
authors.forename: Eiko I
authors.identifier: 0000-0001-7469-594X
authors.initials: EI
authors.lastname: Fried
authors.affiliation: Department of Psychiatry, University Medical Center Groningen, University of Groningen.
authors.forename: Claudia D
authors.initials: CD
authors.lastname: van Borkulo
authors.affiliation: Department of Psychology, University of Amsterdam.
authors.forename: Sacha
authors.initials: S
authors.lastname: Epskamp
authors.affiliation: Department of Psychiatry, University Medical Center Groningen, University of Groningen.
authors.forename: Robert A
authors.initials: RA
authors.lastname: Schoevers
authors.affiliation: Faculty of Psychology and Educational Sciences.
authors.forename: Francis
authors.initials: F
authors.lastname: Tuerlinckx
authors.affiliation: Department of Psychology, University of Amsterdam.
authors.forename: Denny
authors.initials: D
authors.lastname: Borsboom
mesh_terms: D000293:Adolescent; D000328:Adult; D000368:Aged; D003863:Depression / Q000175:diagnosis* / Q000523:psychology; D003865:Major Depressive Disorder / Q000175:diagnosis* / Q000523:psychology; D005163:Factor Analysis, Statistical; D005260:Female; D006801:Humans; D008137:Longitudinal Studies; D008297:Male; D008875:Middle Aged; D015233:Models, Statistical; D011569:Psychiatric Status Rating Scales; D015203:Reproducibility of Results; D055815:Young Adult