An Internet-based evaluation system for a surgical residency program.
BACKGROUND
Efficient and meaningful evaluation of performance is critical to the professional development of trainees in surgical residency programs. Current paper-based evaluation instruments have numerous limitations. We developed an Internet-based evaluation system to more rapidly and efficiently assess the experience of residents, faculty, and rotations.


METHODS
An on-line evaluation system was designed and implemented in October 1999. Custom evaluations were created for residents, faculty, and rotations. Evaluations were completed via the Internet site from remote locations with standard computers and standard Web browser software. Completed evaluations were automatically available on-line for review and data analysis. Data were analyzed by chi-square analysis with a probability value of less than 0.05 considered statistically significant.


RESULTS
Compliance in completion of evaluations improved from 50% to 80% in the initial 6 months of implementation (p < 0.01) with the Web-based system. There was no significant difference between faculty and resident compliance. In evaluation of "ease of use," a total of 612 responses were received over this period with a total average score of 3.5 (5 point scale, 5 = strongly agree). Residents' opinions (average score, 3.69) were slightly more positive than those of faculty (average score, 3.31). Confidentiality was improved over paper-based systems by a detailed security network.


CONCLUSIONS
This Internet-based evaluation system is a potentially powerful instrument for evaluating our surgical residency program and making changes to improve the educational experience in a timely and efficient manner.
D'Cunha
Jonathan
J
Department of Surgery, University of Minnesota Medical School, Minneapolis 55455, USA.
Larson
Cathryn E
CE
Maddaus
Michael A
MA
Landis
George H
GH
D001291:Attitude of Health Personnel; D016009:Chi-Square Distribution; D002983:Clinical Competence / Q000592:standards*; D016494:Computer Security; D005180:Faculty, Medical; D013502:General Surgery / Q000193:education*; D006801:Humans; D020407:Internet / Q000458:organization & administration*; D007396:Internship and Residency / Q000592:standards*; D008910:Minnesota; D015397:Program Evaluation / Q000379:methods*; D012986:Software Validation; D013337:Students, Medical / Q000523:psychology; D013997:Time Factors; D014584:User-Computer Interface; D016526:Workload