title: Extended score interval in the assessment of basic surgical skills.
abstract: BACKGROUND
  The Basic Surgical Skills course uses an assessment score interval of 0-3. An extended score interval, 1-6, was proposed by the Swedish steering committee of the course. The aim of this study was to analyze the trainee scores in the current 0-3 scored version compared to a proposed 1-6 scored version.
  
  
  METHODS
  Sixteen participants, seven females and nine males, were evaluated in the current and proposed assessment forms by instructors, observers, and learners themselves during the first and second day. In each assessment form, 17 tasks were assessed. The inter-rater reliability between the current and the proposed score sheets were evaluated with intraclass correlation (ICC) with 95% confidence intervals (CI).
  
  
  RESULTS
  The distribution of scores for 'knot tying' at the last time point and 'bowel anastomosis side to side' given by the instructors in the current assessment form showed that the highest score was given in 31 and 62%, respectively. No ceiling effects were found in the proposed assessment form. The overall ICC between the current and proposed score sheets after assessment by the instructors increased from 0.38 (95% CI 0.77-0.78) on Day 1 to 0.83 (95% CI 0.51-0.94) on Day 2.
  
  
  CONCLUSIONS
  A clear ceiling effect of scores was demonstrated in the current assessment form, questioning its validity. The proposed score sheet provides more accurate scores and seems to be a better feedback instrument for learning technical surgical skills in the Basic Surgical Skills course.
authors: Vascular Centre, Skåne University Hospital, Malmö, Sweden; Stefan.acosta@telia.com.
authors: Stefan
authors: S
authors: Acosta
authors: Department of Surgery, Skåne University Hospital, Malmö-Lund, Sweden.
authors: Dan
authors: D
authors: Sevonius
authors: Department of General Medicine, Skåne University Hospital, Malmö, Sweden.
authors: Anders
authors: A
authors: Beckman
mesh_terms: D000328:Adult; D002983:Clinical Competence; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D006801:Humans; D007396:Internship and Residency; D008297:Male; D015588:Observer Variation; D015203:Reproducibility of Results; D012737:Sex Factors; D013514:Surgical Procedures, Operative / Q000193:education*; D013548:Sweden
keywords: assessment; basic surgical skills; residents; score interval; surgical education
references: Br J Surg. 2007 Jun;94(6):726-30
references: 17315174
references: Am J Surg. 2012 Nov;204(5):724-31
references: 22608671
references: Qual Life Res. 1995 Aug;4(4):293-307
references: 7550178
references: Med Teach. 2009 Jul;31(7):649-54
references: 19811149
references: Br J Surg. 2011 Jul;98(7):1010-20
references: 21480195
references: Med Educ. 2002 Jan;36(1):92-7
references: 11849528
references: Gastrointest Endosc. 2012 Mar;75(3):591-7
references: 22227035
references: Am J Surg. 1997 Mar;173(3):226-30
references: 9124632
references: Ann R Coll Surg Engl. 2008 May;90(4):286-90
references: 18492390
references: Am J Surg. 2005 Jun;189(6):647-50
references: 15910713
references: Br J Surg. 2006 Sep;93(9):1139-46
references: 16838394
references: Med Teach. 2011;33(9):e479-84
references: 21854141
references: Surgery. 2012 Jun;151(6):803-7
references: 22652121
references: ANZ J Surg. 2013 Jun;83(6):412-6
references: 23647783
references: Eur J Dent Educ. 2011 Feb;15(1):42-6
references: 21226805
references: J Surg Educ. 2012 Nov-Dec;69(6):798-801
references: 23111049
references: Br J Surg. 2010 Jul;97(7):972-87
references: 20632260
references: Ann Surg. 2013 May;257(5):839-44
references: 23295321
references: Med Educ. 2010 Jan;44(1):16-7
references: 20078751