Psychometric properties of performance-based measurements of functional capacity: test-retest reliability, practice effects, and potential sensitivity to change.
Performance-based measures of the ability to perform social and everyday living skills are being more widely used to assess functional capacity in people with serious mental illnesses such as schizophrenia and bipolar disorder. Since they are also being used as outcome measures in pharmacological and cognitive remediation studies aimed at cognitive impairments in schizophrenia, understanding their measurement properties and potential sensitivity to change is important. In this study, the test-retest reliability, practice effects, and reliable change indices of two different performance-based functional capacity measures, the UCSD Performance-Based Skills Assessment (UPSA) and Social Skills Performance Assessment (SSPA) were examined over several different retest intervals in two different samples of people with schizophrenia (n's=238 and 116) and a healthy comparison sample (n=109). These psychometric properties were compared to those of a neuropsychological assessment battery. Test-retest reliabilities of the long form of the UPSA ranged from r=63 to r=80 over follow-up periods up to 36 months in people with schizophrenia, while brief UPSA reliabilities ranged from r=66 to r=81. Test-retest reliability of the NP performance scores ranged from r=77 to r=79. Test-retest reliabilities of the UPSA were lower in healthy controls, while NP performance was slightly more reliable. SSPA test-retest reliability was lower. Practice effect sizes ranged from .05 to .16 for the UPSA and .07 to .19 for the NP assessment in patients, with HC having more practice effects. Reliable change intervals were consistent across NP and both FC measures, indicating equal potential for detection of change. These performance-based measures of functional capacity appear to have similar potential to be sensitive to change compared to NP performance in people with schizophrenia.
Leifker
Feea R
FR
Department of Psychology, The Pennsylvania State University, State College, PA, USA.
Patterson
Thomas L
TL
Bowie
Christopher R
CR
Mausbach
Brent T
BT
Harvey
Philip D
PD
D000203:Activities of Daily Living / Q000145:classification / Q000523:psychology*; D000328:Adult; D000368:Aged; D003072:Cognition Disorders / Q000175:diagnosis* / Q000523:psychology / Q000534:rehabilitation; D004185:Disability Evaluation; D005260:Female; D006801:Humans; D007398:Interpersonal Relations; D008137:Longitudinal Studies; D008297:Male; D008875:Middle Aged; D009483:Neuropsychological Tests / Q000706:statistics & numerical data; D009518:New York; D011594:Psychometrics / Q000706:statistics & numerical data; D011618:Psychotic Disorders / Q000175:diagnosis* / Q000523:psychology / Q000534:rehabilitation; D012016:Reference Values; D015203:Reproducibility of Results; D012112:Residential Facilities; D012559:Schizophrenia / Q000175:diagnosis* / Q000534:rehabilitation; D012564:Schizophrenic Language; D012565:Schizophrenic Psychology; D012917:Social Adjustment; D012919:Social Behavior; D012931:Social Environment
J Psychiatr Res. 2007 Jan-Feb;41(1-2):97-118
16360706
Schizophr Res. 2004 Dec 15;72(1):5-9
15531402
Arch Gen Psychiatry. 1992 Aug;49(8):615-23
1637251
Am J Psychiatry. 2006 Mar;163(3):418-25
16513862
Neuropsychol Rev. 2009 Sep;19(3):324-35
19507034
Schizophr Res. 2008 Nov;106(1):50-8
18053687
Schizophr Res. 2007 Jan;89(1-3):330-8
16982175
Schizophr Bull. 2011 Mar;37(2):334-43
19525354
Schizophr Res. 2001 Mar 30;48(2-3):351-60
11295387
Biol Psychiatry. 2008 Mar 1;63(5):505-11
17662256
Am J Psychiatry. 2006 Nov;163(11):1918-25
17074943
Am J Psychiatry. 2008 Feb;165(2):221-8
18172017
Schizophr Res. 2006 Sep;86(1-3):291-9
16814526
Bipolar Disord. 2010 Feb;12(1):45-55
20148866
J Psychiatr Res. 1975 Nov;12(3):189-98
1202204
Am J Psychiatry. 2005 Jan;162(1):110-7
15625208
Schizophr Bull. 2007 Nov;33(6):1364-72
17341468
Schizophr Bull. 2007 Sep;33(5):1138-48
17493956
Schizophr Bull. 2001;27(2):235-45
11354591
Schizophr Bull. 1987;13(2):261-76
3616518
Arch Clin Neuropsychol. 2001 Jan;16(1):75-91
14590193
Biol Psychiatry. 2004 Sep 1;56(5):301-7
15336511
Schizophr Res. 2009 Nov;115(1):82-7
19775869