Initial reliability of the Standardized Orthopedic Assessment Tool (SOAT).
BACKGROUND
Orthopaedic assessment skills are critical to the success of athletic therapists and trainers. The Standardized Orthopedic Assessment Tool (SOAT) has been content validated.


OBJECTIVE
To establish interrater reliability of the SOAT.


METHODS
Thirty-two college students, 10 raters, and 2 standardized patients (SPs) from Calgary, Alberta, Canada.


METHODS
Randomized observational study.


METHODS
Students were allowed 30 minutes to complete a mock orthopaedic assessment of an SP with an injury specific to a region of the body (shoulder, knee, or ankle). Using the region-specific SOAT, raters and SPs evaluated students' orthopaedic assessment skills.


METHODS
The sum totals of the SOAT for 2 raters and 1 SP were used to calculate each student's performance scores for respective scenarios. Scale reliability analysis (Cronbach alpha) was completed on the SOAT for each of the 3 body-region examinations.


RESULTS
The mean overall reliability of 3 SOATs (ie, ankle, knee, and shoulder) was positive: alpha = .85 with the SP scores factored into the equation and alpha = .86 without the SP scores factored into the equation. Reliability for the ankle region was highest (alpha = .91), followed by the knee (alpha = .83) and the shoulder (alpha = .82).


CONCLUSIONS
The study sample size was small, but the results will enable further study with generalization to a broader audience of athletic therapists and athletic trainers. Because a baseline measure of reliability was established using a robust statistical analysis, future researchers can employ more stringent statistical analysis and focus on the effects of various pedagogical techniques to teach and learn the underlying construct of clinical competence in orthopaedic assessment.
Lafave
Mark R
MR
Mount Royal College, Calgary, AB, Canada. mlafave@mtroyal.ca
Katz
Larry
L
Donnon
Tyrone
T
Butterwick
Dale J
DJ
D000328:Adult; D001265:Athletic Injuries / Q000175:diagnosis* / Q000503:physiopathology; D005260:Female; D006305:Health Status Indicators; D006801:Humans; D008297:Male; D009140:Musculoskeletal Diseases / Q000175:diagnosis* / Q000503:physiopathology; D015588:Observer Variation; D009985:Orthopedics / Q000379:methods / Q000592:standards*; D016544:Patient Simulation; D010808:Physical Examination; D015203:Reproducibility of Results; D013997:Time Factors