title: Impact of training on rating competence in cognitive therapy.
abstract: This naturalistic study examines the impact of a training package on the inter-rater reliability scores of a scale devised to measure competence in cognitive therapy (CT). The study was conducted at the Newcastle Cognitive and Behavioural Therapies Centre, where trainees are routinely required to submit videotapes of their therapeutic work for marking independently by two supervisors. This process was used as vehicle for the present work, whereby the trainees' videos were assessed in terms of their competence using a recently revised rating scale (CTS-R). The inter-rater reliability of the supervisors' ratings was assessed both before and after the administration of a teaching package designed to improve the reliability in the use of the CTS-R. The results showed an improvement in the inter-rater agreement of five out of 12 items of the scale. The overall agreement also improved significantly following training.
authors.affiliation: Centre for the Health of the Elderly, Newcastle General Hospital, Westgate Road, Newcastle upon Tyne, NE4 6BE, UK. ianjamesncht@yahoo.com
authors.forename: F Katharina
authors.initials: FK
authors.lastname: Reichelt
authors.forename: Ian A
authors.initials: IA
authors.lastname: James
authors.forename: Ivy-Marie
authors.initials: IM
authors.lastname: Blackburn
mesh_terms: D000328:Adult; D001521:Behavior Therapy; D015928:Cognitive Behavioral Therapy / Q000379:methods / Q000592:standards*; D004521:Educational Measurement; D005069:Evaluation Studies as Topic; D005260:Female; D006801:Humans; D007318:Inservice Training; D008297:Male; D016743:Mental Competency; D008875:Middle Aged; D009483:Neuropsychological Tests; D011569:Psychiatric Status Rating Scales; D011594:Psychometrics; D015203:Reproducibility of Results; D013663:Teaching; D014743:Videotape Recording / Q000379:methods