title: Psychometric properties of performance-based measurements of functional capacity: test-retest reliability, practice effects, and potential sensitivity to change.
abstract: Performance-based measures of the ability to perform social and everyday living skills are being more widely used to assess functional capacity in people with serious mental illnesses such as schizophrenia and bipolar disorder. Since they are also being used as outcome measures in pharmacological and cognitive remediation studies aimed at cognitive impairments in schizophrenia, understanding their measurement properties and potential sensitivity to change is important. In this study, the test-retest reliability, practice effects, and reliable change indices of two different performance-based functional capacity measures, the UCSD Performance-Based Skills Assessment (UPSA) and Social Skills Performance Assessment (SSPA) were examined over several different retest intervals in two different samples of people with schizophrenia (n's=238 and 116) and a healthy comparison sample (n=109). These psychometric properties were compared to those of a neuropsychological assessment battery. Test-retest reliabilities of the long form of the UPSA ranged from r=63 to r=80 over follow-up periods up to 36 months in people with schizophrenia, while brief UPSA reliabilities ranged from r=66 to r=81. Test-retest reliability of the NP performance scores ranged from r=77 to r=79. Test-retest reliabilities of the UPSA were lower in healthy controls, while NP performance was slightly more reliable. SSPA test-retest reliability was lower. Practice effect sizes ranged from .05 to .16 for the UPSA and .07 to .19 for the NP assessment in patients, with HC having more practice effects. Reliable change intervals were consistent across NP and both FC measures, indicating equal potential for detection of change. These performance-based measures of functional capacity appear to have similar potential to be sensitive to change compared to NP performance in people with schizophrenia.
authors.affiliation: Department of Psychology, The Pennsylvania State University, State College, PA, USA.
authors.forename: Feea R
authors.initials: FR
authors.lastname: Leifker
authors.forename: Thomas L
authors.initials: TL
authors.lastname: Patterson
authors.forename: Christopher R
authors.initials: CR
authors.lastname: Bowie
authors.forename: Brent T
authors.initials: BT
authors.lastname: Mausbach
authors.forename: Philip D
authors.initials: PD
authors.lastname: Harvey
mesh_terms: D000203:Activities of Daily Living / Q000145:classification / Q000523:psychology*; D000328:Adult; D000368:Aged; D003072:Cognition Disorders / Q000175:diagnosis* / Q000523:psychology / Q000534:rehabilitation; D004185:Disability Evaluation; D005260:Female; D006801:Humans; D007398:Interpersonal Relations; D008137:Longitudinal Studies; D008297:Male; D008875:Middle Aged; D009483:Neuropsychological Tests / Q000706:statistics & numerical data; D009518:New York; D011594:Psychometrics / Q000706:statistics & numerical data; D011618:Psychotic Disorders / Q000175:diagnosis* / Q000523:psychology / Q000534:rehabilitation; D012016:Reference Values; D015203:Reproducibility of Results; D012112:Residential Facilities; D012559:Schizophrenia / Q000175:diagnosis* / Q000534:rehabilitation; D012564:Schizophrenic Language; D012565:Schizophrenic Psychology; D012917:Social Adjustment; D012919:Social Behavior; D012931:Social Environment
references.citation: J Psychiatr Res. 2007 Jan-Feb;41(1-2):97-118
references.pmid: 16360706
references.citation: Schizophr Res. 2004 Dec 15;72(1):5-9
references.pmid: 15531402
references.citation: Arch Gen Psychiatry. 1992 Aug;49(8):615-23
references.pmid: 1637251
references.citation: Am J Psychiatry. 2006 Mar;163(3):418-25
references.pmid: 16513862
references.citation: Neuropsychol Rev. 2009 Sep;19(3):324-35
references.pmid: 19507034
references.citation: Schizophr Res. 2008 Nov;106(1):50-8
references.pmid: 18053687
references.citation: Schizophr Res. 2007 Jan;89(1-3):330-8
references.pmid: 16982175
references.citation: Schizophr Bull. 2011 Mar;37(2):334-43
references.pmid: 19525354
references.citation: Schizophr Res. 2001 Mar 30;48(2-3):351-60
references.pmid: 11295387
references.citation: Biol Psychiatry. 2008 Mar 1;63(5):505-11
references.pmid: 17662256
references.citation: Am J Psychiatry. 2006 Nov;163(11):1918-25
references.pmid: 17074943
references.citation: Am J Psychiatry. 2008 Feb;165(2):221-8
references.pmid: 18172017
references.citation: Schizophr Res. 2006 Sep;86(1-3):291-9
references.pmid: 16814526
references.citation: Bipolar Disord. 2010 Feb;12(1):45-55
references.pmid: 20148866
references.citation: J Psychiatr Res. 1975 Nov;12(3):189-98
references.pmid: 1202204
references.citation: Am J Psychiatry. 2005 Jan;162(1):110-7
references.pmid: 15625208
references.citation: Schizophr Bull. 2007 Nov;33(6):1364-72
references.pmid: 17341468
references.citation: Schizophr Bull. 2007 Sep;33(5):1138-48
references.pmid: 17493956
references.citation: Schizophr Bull. 2001;27(2):235-45
references.pmid: 11354591
references.citation: Schizophr Bull. 1987;13(2):261-76
references.pmid: 3616518
references.citation: Arch Clin Neuropsychol. 2001 Jan;16(1):75-91
references.pmid: 14590193
references.citation: Biol Psychiatry. 2004 Sep 1;56(5):301-7
references.pmid: 15336511
references.citation: Schizophr Res. 2009 Nov;115(1):82-7
references.pmid: 19775869