Break the data-bank with Monte Carlo? Statistical problems in the dispute between Conroy (1996) and Crinella, McCleary, and Swanson (1998)
In drawing entirely different conclusions from the same bank of data, Conroy saw consistent evidence favoring the alternative CLAs over the small ICFs in Pennsylvania while Crinella et al. found a large regression artifact produced by matching the ICF and CLA residents on adaptive behavior scores. Ten areas of flawed logic, analysis, and interpretation have undermined both sides of the argument. Conroy's matching--which might not have been necessary in the first place--does not pose a serious threat of regression artifacts. Because of two subtle but fatal errors, the Monte Carlo experiment of Crinella et al. provides no important evidence against Conroy's findings. Other problems, however, require a small reduction in his pro-CLA results, along with a substantial limit on their generalizability.
Heifetz
L J
LJ
D016477:Artifacts; D003688:Deinstitutionalization / Q000706:statistics & numerical data*; D006801:Humans; D008607:Intellectual Disability / Q000534:rehabilitation*; D007380:Intermediate Care Facilities / Q000706:statistics & numerical data*; D009010:Monte Carlo Method; D015397:Program Evaluation / Q000706:statistics & numerical data; D011788:Quality of Life; D012044:Regression Analysis