The Shoulder Objective Practical Assessment Tool: Evaluation of a New Tool Assessing Residents Learning in Diagnostic Shoulder Arthroscopy.
OBJECTIVE
To design and validate an objective practical assessment tool for diagnostic shoulder arthroscopy that would provide residents with a method to evaluate their progression in this field of surgery and to identify specific learning needs.


METHODS
We designed and evaluated the shoulder Objective Practical Assessment Tool (OPAT). The shoulder OPAT was designed by us, and scoring domains were created using a Delphi process. The shoulder OPAT was trialed by members of the British Elbow & Shoulder Society Education Committee for internal consistency and ease of use before being offered to other trainers and residents. Inter-rater reliability and intrarater reliability were calculated. One hundred forty orthopaedic residents, of varying seniority, within 5 training regions in the United Kingdom, were questioned regarding the tool. A pilot study of 6 residents was undertaken.


RESULTS
Internal consistency was 0.77 (standardized Cronbach α). Inter-rater reliability was 0.60, and intrarater reliability was 0.82. The Spearman correlation coefficient (r) between the global summary score for the shoulder OPAT and the current assessment tool used in postgraduate training for orthopaedic residents undertaking diagnostic shoulder arthroscopy equaled 0.74. Of the residents, 82% agreed or strongly agreed when asked if the shoulder OPAT would be a useful tool in monitoring progression and 72% agreed or strongly agreed with the introduction of the shoulder OPAT within the orthopaedic domain.


CONCLUSIONS
This study shows that the shoulder OPAT fulfills several aspects of reliability and validity when tested. Despite the inter-rater reliability being 0.60, we believe that the shoulder OPAT has the potential to play a role alongside the current assessment tool in the training of orthopaedic residents.


CONCLUSIONS
The shoulder OPAT can be used to assess residents during shoulder arthroscopy and has the potential for use in medical education, as well as arthroscopic skills training in the operating theater.
Department of Orthopaedics, University Hospitals of Morecambe Bay, Royal Lancaster Infirmary, Lancaster, England. Electronic address: Christalbot@doctors.org.uk.
Christopher L
CL
Talbot
Department of Orthopaedics, University Hospital of South Manchester, Manchester, England.
Edward M
EM
Holt
Nottingham Shoulder and Elbow Unit, Nottingham University Hospitals, Nottingham, England.
Benjamin W T
BW
Gooding
Shoulder Unit, St. George's Hospital, London, England.
Thomas D
TD
Tennent
Department of Statistics, University Hospital of South Manchester, Manchester, England.
Philip
P
Foden
D001182:Arthroscopy / Q000193:education*; D002983:Clinical Competence; D006801:Humans; D007396:Internship and Residency; D007592:Joint Diseases / Q000175:diagnosis*; D008297:Male; D009985:Orthopedics / Q000193:education; D010865:Pilot Projects; D015203:Reproducibility of Results; D012782:Shoulder; D012785:Shoulder Joint / Q000601:surgery*