title: Overall performance of Oort's procedure for response shift detection at item level: a pilot simulation study.
abstract: OBJECTIVE
  This simulation study was designed to provide data on the performance of Oort's procedure (OP) for response shift (RS) detection (regarding type I error, power, and overall performance), according to sample characteristics, at item level. A specific objective was to assess the impact of using different information criteria (IC), as alternatives to the LRT (likelihood-ratio test), for global assessment of RS occurrence.
  
  
  METHODS
  Responses to five binary items at two times of measurement were simulated. Thirty-six combinations of sample characteristics [sample size (n), "true change," correlations between the two latent variables and presence/absence of uniform recalibration RS (ur)] were considered. A thousand datasets were generated for each combination. RS detection was performed on each dataset following OP. Type I error and power of the global assessment of RS occurrence, as well as overall performance of the OP, were assessed.
  
  
  RESULTS
  The estimated type I error was close to 5 % for the LRT and lower than 5 % for the IC. The estimated power was higher for the LRT as compared to the AIC, which was the highest among the other IC. For the LRT, the estimated power for n = 100 and for the combination of n = 200 and ur = 1 item was below 80 %. Otherwise, for other combinations of sample characteristics, the estimated power was above 90 %.
  
  
  CONCLUSIONS
  For the LRT, higher values of power were estimated compared to IC with appropriate values of type I error. These results were consistent with Oort's proposal to use the LRT as the criterion to assess global RS occurrence.
authors: EA 4275 Biostatistics Pharmacoepidemiology and Subjective Measures in Health Sciences, LUNAM, University of Nantes, Nantes, France, antoine.vanier@psl.aphp.fr.
authors: Antoine
authors: A
authors: Vanier
authors: Véronique
authors: V
authors: Sébille
authors: Myriam
authors: M
authors: Blanchin
authors: Alice
authors: A
authors: Guilleux
authors: Jean-Benoit
authors: JB
authors: Hardouin
mesh_terms: D000465:Algorithms; D002908:Chronic Disease / Q000523:psychology*; D006801:Humans; D015233:Models, Statistical; D009369:Neoplasms / Q000523:psychology; D017063:Outcome Assessment, Health Care / Q000379:methods*; D010865:Pilot Projects; D011788:Quality of Life / Q000523:psychology*; D012107:Research Design; D018401:Sample Size