title: Inter-rater Agreement on Final Competency Testing Utilizing Standardized Patients.
abstract: The purpose of this study was to determine whether licensed physical therapists (n=8) serving as standardized patients (SPs) for practical examinations evaluate physical therapy students (n=51) equivalently to the physical therapy course instructor (n=1).
  
  
  METHODS
  The SPs completed the same assessment based on the evaluation criteria as did the instructor. The scores for the practical examination, answers to three questions, and the documentation note were summarized separately for the SP and the instructor by means and standard deviations. A paired t-test and an intraclass correlation coefficient (ICC) for each aspect of the score were calculated. ICC(1,1) values were reported along with corresponding 95% confidence intervals.
  
  
  RESULTS
  The instructor had significantly higher scores for the practical exam and the overall score compared to the ratings from the SPs. No differences were observed between the instructor and SP scores on the three answers to the questions and documentation note scores.
  
  
  CONCLUSIONS
  Based on the ICC values identified in this study, a physical therapist serving as an SP may not be an adequate replacement for an instructor when it comes to grading physical therapy students on all aspects of their competency tests.
authors.affiliation: Department of Physical Therapy, PO Box 980224, Virginia Commonwealth University, Richmond, VA 23298, USA. Tel 804-828-4766, fax 804-828-8111. dhbowman@vcu.edu.
authors.forename: Dixie H
authors.initials: DH
authors.lastname: Bowman
authors.forename: Kyle L
authors.initials: KL
authors.lastname: Ferber
authors.forename: Adam P
authors.initials: AP
authors.lastname: Sima
mesh_terms: D002983:Clinical Competence; D004521:Educational Measurement / Q000379:methods*; D005178:Faculty; D005260:Female; D006801:Humans; D008297:Male; D016544:Patient Simulation; D059825:Physical Therapists; D026761:Physical Therapy Specialty / Q000193:education*; D015203:Reproducibility of Results; D013336:Students, Health Occupations / Q000523:psychology*