title: An electronic portfolio for quantitative assessment of surgical skills in undergraduate medical education.
abstract: BACKGROUND
  We evaluated a newly designed electronic portfolio (e-Portfolio) that provided quantitative evaluation of surgical skills. Medical students at the University of Seville used the e-Portfolio on a voluntary basis for evaluation of their performance in undergraduate surgical subjects.
  
  
  METHODS
  Our new web-based e-Portfolio was designed to evaluate surgical practical knowledge and skills targets. Students recorded each activity on a form, attached evidence, and added their reflections. Students self-assessed their practical knowledge using qualitative criteria (yes/no), and graded their skills according to complexity (basic/advanced) and participation (observer/assistant/independent). A numerical value was assigned to each activity, and the values of all activities were summated to obtain the total score. The application automatically displayed quantitative feedback. We performed qualitative evaluation of the perceived usefulness of the e-Portfolio and quantitative evaluation of the targets achieved.
  
  
  RESULTS
  Thirty-seven of 112 students (33%) used the e-Portfolio, of which 87% reported that they understood the methodology of the portfolio. All students reported an improved understanding of their learning objectives resulting from the numerical visualization of progress, all students reported that the quantitative feedback encouraged their learning, and 79% of students felt that their teachers were more available because they were using the e-Portfolio. Only 51.3% of students reported that the reflective aspects of learning were useful. Individual students achieved a maximum of 65% of the total targets and 87% of the skills targets. The mean total score was 345 ± 38 points. For basic skills, 92% of students achieved the maximum score for participation as an independent operator, and all achieved the maximum scores for participation as an observer and assistant. For complex skills, 62% of students achieved the maximum score for participation as an independent operator, and 98% achieved the maximum scores for participation as an observer or assistant.
  
  
  CONCLUSIONS
  Medical students reported that use of an electronic portfolio that provided quantitative feedback on their progress was useful when the number and complexity of targets were appropriate, but not when the portfolio offered only formative evaluations based on reflection. Students felt that use of the e-Portfolio guided their learning process by indicating knowledge gaps to themselves and teachers.
authors: Department of Otorhinolaryngology, Virgen Macarena University Hospital, C/Fernández de Rivera 16, B, 9° D, Seville 41005, Spain. sanchezsg@ono.com
authors: Serafín
authors: S
authors: Sánchez Gómez
authors: Elisa María Cabot
authors: EM
authors: Ostos
authors: Juan Manuel Maza
authors: JM
authors: Solano
authors: Tomás Francisco Herrero
authors: TF
authors: Salado
mesh_terms: D002983:Clinical Competence / Q000592:standards*; D004504:Education, Medical, Undergraduate / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D013502:General Surgery / Q000193:education / Q000592:standards; D006801:Humans; D013514:Surgical Procedures, Operative / Q000193:education* / Q000592:standards
references: Med Teach. 2009 Sep;31(9):790-801
references: 19811183
references: BMC Med Educ. 2006 Jan 12;6:4
references: 16409640
references: Med Educ. 2004 Apr;38(4):378-89
references: 15025639
references: Med Educ. 1998 Jul;32(4):401-6
references: 9743803
references: Med Teach. 2009 Apr;31(4):282-98
references: 19404891
references: Med Educ. 2005 Apr;39(4):436
references: 15813767
references: Med Teach. 2010;32(8):663-8
references: 20662578
references: BMC Med Educ. 2012 Aug 13;12:75
references: 22889271
references: BMC Med Educ. 2011 Dec 06;11:101
references: 22141427
references: Lancet. 2001 Mar 24;357(9260):945-9
references: 11289364
references: BMC Med Educ. 2009 Dec 01;9:69
references: 19951406
references: Med Teach. 2009 Aug;31(8):685-95
references: 19811204
references: Med Teach. 2009 Apr;31(4):364-5
references: 19404895
references: Med Educ. 2007 Dec;41(12):1224-33
references: 18045373
references: Med Educ. 2001 Jul;35(7):624-31
references: 11437963
references: Med Educ. 2006 Feb;40(2):173-9
references: 16451246
references: Med Teach. 2010;32(8):676-82
references: 20662580
references: Curr Surg. 2006 Nov-Dec;63(6):444-7
references: 17084776
references: Med Teach. 2001 Oct;23(6):535-551
references: 12098472
references: Med Teach. 2010;32(8):629-30
references: 20662572
references: Adv Health Sci Educ Theory Pract. 2004;9(3):211-24
references: 15316272
references: Med Educ. 2005 Dec;39(12):1230-5
references: 16313582
references: Med Educ. 2007 Nov;41(11):1067-73
references: 17973767