title: The Arthroscopic Surgical Skill Evaluation Tool (ASSET).
abstract: BACKGROUND
  Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice; however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking.
  
  
  OBJECTIVE
  The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability when used to assess the technical ability of surgeons performing diagnostic knee arthroscopic surgery on cadaveric specimens.
  
  
  METHODS
  Cross-sectional study; Level of evidence, 3.
  
  
  METHODS
  Content validity was determined by a group of 7 experts using the Delphi method. Intra-articular performance of a right and left diagnostic knee arthroscopic procedure was recorded for 28 residents and 2 sports medicine fellowship-trained attending surgeons. Surgeon performance was assessed by 2 blinded raters using the ASSET. Concurrent criterion-oriented validity, interrater reliability, and test-retest reliability were evaluated.
  
  
  RESULTS
  Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in the total ASSET score (P < .05) between novice, intermediate, and advanced experience groups were identified. Interrater reliability: The ASSET scores assigned by each rater were strongly correlated (r = 0.91, P < .01), and the intraclass correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: There was a significant correlation between ASSET scores for both procedures attempted by each surgeon (r = 0.79, P < .01).
  
  
  CONCLUSIONS
  The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopic surgery in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live operating room and other simulated environments.
authors.affiliation: School of Medicine, University of Rochester, Rochester, NY 14642, USA.
authors.forename: Ryan J
authors.initials: RJ
authors.lastname: Koehler
authors.forename: Simon
authors.initials: S
authors.lastname: Amsdell
authors.forename: Elizabeth A
authors.initials: EA
authors.lastname: Arendt
authors.forename: Leslie J
authors.initials: LJ
authors.lastname: Bisson
authors.forename: Jonathan P
authors.initials: JP
authors.lastname: Braman
authors.forename: Jonathan P
authors.initials: JP
authors.lastname: Bramen
authors.forename: Aaron
authors.initials: A
authors.lastname: Butler
authors.forename: Andrew J
authors.initials: AJ
authors.lastname: Cosgarea
authors.forename: Christopher D
authors.initials: CD
authors.lastname: Harner
authors.forename: William E
authors.initials: WE
authors.lastname: Garrett
authors.forename: Tyson
authors.initials: T
authors.lastname: Olson
authors.forename: Winston J
authors.initials: WJ
authors.lastname: Warme
authors.forename: Gregg T
authors.initials: GT
authors.lastname: Nicandri
mesh_terms: D001182:Arthroscopy / Q000592:standards*; D002102:Cadaver; D002983:Clinical Competence / Q000592:standards*; D003430:Cross-Sectional Studies; D004650:Employee Performance Appraisal / Q000379:methods*; D006801:Humans; D007396:Internship and Residency; D007719:Knee Joint; D015588:Observer Variation; D010820:Physicians; D015203:Reproducibility of Results; D016037:Single-Blind Method; D014741:Video Recording
keywords: arthroscopic surgery; assessment; education; proficiency
references.citation: Surg Endosc. 2010 Aug;24(8):1834-41
references.pmid: 20112113
references.citation: J Grad Med Educ. 2010 Dec;2(4):523-9
references.pmid: 22132272
references.citation: Ann Surg. 2007 Jun;245(6):992-9
references.pmid: 17522527
references.citation: IEEE Trans Biomed Eng. 2006 Oct;53(10):1911-9
references.pmid: 17019854
references.citation: J Bone Joint Surg Am. 2009 Dec;91(12):2811-7
references.pmid: 19952242
references.citation: Med Teach. 2010;32(10):830-6
references.pmid: 20854159
references.citation: J Adv Nurs. 1994 Jan;19(1):180-6
references.pmid: 8138622
references.citation: Resuscitation. 2012 Apr;83(4):434-9
references.pmid: 22040777
references.citation: Biometrics. 1977 Mar;33(1):159-74
references.pmid: 843571
references.citation: J Bone Joint Surg Am. 2009 Sep;91(9):2287-95
references.pmid: 19724008
references.citation: Am J Surg. 2011 Feb;201(2):251-9
references.pmid: 20832048
references.citation: Am J Surg. 2011 Oct;202(4):469-480.e6
references.pmid: 21798511
references.citation: J Am Coll Surg. 2007 Feb;204(2):308-13
references.pmid: 17254935
references.citation: Acad Med. 2004 Oct;79(10 Suppl):S70-81
references.pmid: 15383395
references.citation: J Am Acad Orthop Surg. 2012 Jul;20(7):410-22
references.pmid: 22751160
references.citation: Clin Orthop Relat Res. 2009 Feb;467(2):546-52
references.pmid: 18791774
references.citation: Chirurgia (Bucur). 2009 Mar-Apr;104(2):181-5
references.pmid: 19499661
references.citation: Health Aff (Millwood). 2002 Sep-Oct;21(5):103-11
references.pmid: 12224871
references.citation: J Bone Joint Surg Br. 2008 Apr;90(4):494-9
references.pmid: 18378926
references.citation: J Clin Epidemiol. 2003 Dec;56(12):1150-6
references.pmid: 14680664
references.citation: N Engl J Med. 2012 Mar 15;366(11):1051-6
references.pmid: 22356262
references.citation: Acad Med. 2010 May;85(5):869-80
references.pmid: 20520044
references.citation: Br J Surg. 1997 Feb;84(2):273-8
references.pmid: 9052454
references.citation: Ann Surg. 2008 Feb;247(2):372-9
references.pmid: 18216547
references.citation: J Am Acad Orthop Surg. 2012 Jul;20(7):407-9
references.pmid: 22751159
references.citation: Acad Med. 2008 Aug;83(8):761-7
references.pmid: 18667892
references.citation: Am J Surg. 2005 Jul;190(1):107-13
references.pmid: 15972181
references.citation: Arthroscopy. 2008 Mar;24(3):335-42
references.pmid: 18308187
references.citation: Stud Health Technol Inform. 2012;173:129-35
references.pmid: 22356973
references.citation: Minim Invasive Ther Allied Technol. 2010;19(1):24-9
references.pmid: 20095894
references.citation: Surg Endosc. 2009 Jun;23(6):1227-32
references.pmid: 19057949
references.citation: Surg Innov. 2007 Sep;14(3):211-6
references.pmid: 17928621
references.citation: Am J Public Health. 1984 Sep;74(9):979-83
references.pmid: 6380323