Impact of training on rating competence in cognitive therapy.
This naturalistic study examines the impact of a training package on the inter-rater reliability scores of a scale devised to measure competence in cognitive therapy (CT). The study was conducted at the Newcastle Cognitive and Behavioural Therapies Centre, where trainees are routinely required to submit videotapes of their therapeutic work for marking independently by two supervisors. This process was used as vehicle for the present work, whereby the trainees' videos were assessed in terms of their competence using a recently revised rating scale (CTS-R). The inter-rater reliability of the supervisors' ratings was assessed both before and after the administration of a teaching package designed to improve the reliability in the use of the CTS-R. The results showed an improvement in the inter-rater agreement of five out of 12 items of the scale. The overall agreement also improved significantly following training.
Reichelt
F Katharina
FK
Centre for the Health of the Elderly, Newcastle General Hospital, Westgate Road, Newcastle upon Tyne, NE4 6BE, UK. ianjamesncht@yahoo.com
James
Ian A
IA
Blackburn
Ivy-Marie
IM
D000328:Adult; D001521:Behavior Therapy; D015928:Cognitive Behavioral Therapy / Q000379:methods / Q000592:standards*; D004521:Educational Measurement; D005069:Evaluation Studies as Topic; D005260:Female; D006801:Humans; D007318:Inservice Training; D008297:Male; D016743:Mental Competency; D008875:Middle Aged; D009483:Neuropsychological Tests; D011569:Psychiatric Status Rating Scales; D011594:Psychometrics; D015203:Reproducibility of Results; D013663:Teaching; D014743:Videotape Recording / Q000379:methods