Reliability of the Perceive, Recall, Plan and Perform System of Task Analysis: a criterion-referenced assessment.
OBJECTIVE
To conduct preliminary examination of the rater and test-reliability of the Perceive, Recall, Plan and Perform (PRPP) System of Task Analysis, an ecological measure designed to assess task-embedded information processing capacity during occupational therapy assessment of confused and agitated adults following traumatic brain injury.


METHODS
Occupational therapists observed and scored client performance using the PRPP System of Task Analysis. Correlational analysis and measures of agreement were performed to determine interrater and intrarater reliability. Test procedures were examined for reliability and internal consistency.


RESULTS
Interrater and test reliability considered three factors: therapists, clients and tasks. A moderate level of interrater reliability was achieved between trained therapists (intraclass correlation coefficient (ICC) = 0.60). Test procedures were highly reliable (ICC = 0.88). Across two measurement occasions, therapists showed a tendency towards harder rating on the second test occasion (-4.5%; 95% confidence interval for: -10.67% → 3.17%).


CONCLUSIONS
The findings of this study support the use of criterion-referenced tests in the area of occupational performance measurement. Occupational therapists achieved moderate interrater reliability when measuring the performance of adults with brain injury on various activities of daily living. Test procedures were found to be highly reliable in measuring the occupational performance of adults demonstrating confusion and agitation typical to the stage of post-traumatic amnesia following head injury.
Nott
Melissa T
MT
Royal Perth Hospital, Shenton Park Campus, 6 Selby Street, Shenton Park, WA 6008, Australia.
Chapparo
Christine
C
Heard
Robert
R
D000328:Adult; D000704:Analysis of Variance; D001315:Australia; D001930:Brain Injuries / Q000150:complications / Q000534:rehabilitation*; D003072:Cognition Disorders / Q000209:etiology / Q000534:rehabilitation*; D005260:Female; D006801:Humans; D008297:Male; D011939:Mental Recall; D008875:Middle Aged; D008960:Models, Psychological; D015588:Observer Variation; D009788:Occupational Therapy / Q000379:methods*; D011595:Psychomotor Agitation / Q000209:etiology / Q000534:rehabilitation*; D015203:Reproducibility of Results; D013647:Task Performance and Analysis; D055815:Young Adult