Impact of electronic resident evaluation systems on the timeliness, rate, and quality of responses. Survey of Association of Program Directors in Radiology members.
OBJECTIVE
To determine the impact of electronic resident evaluation systems on the timeliness, rate, and quality of responses.


METHODS
Surveys were mailed electronically to the membership of the Association of Program Directors in Radiology, which included the directors of 158 residency programs. Respondents were instructed to send 1 response from each program. Information gathered included the use of electronic compared with paper-based evaluation systems and the overall level of satisfaction with such systems (rated on a 5-point scale with 1 = dissatisfied and 5 = satisfied). Questions were asked regarding the impact of electronic systems on the timeliness, rate, and quality of responses.


RESULTS
Seventy-seven responses were received, for an estimated response rate of 49% on a per-program basis. Of these 77 respondents, 45 (58%) used electronic systems and 32 (42%) used paper-based systems. The median level of satisfaction was equivalent (4 = somewhat satisfied) for both groups. Of the 45 respondents using electronic systems, 26 (58%) reported increased response rates, 16 (36%) reported no change, and 3 (7%) reported decreased response rates compared with paper-based systems. Regarding the timeliness of responses, 31 (69%) reported faster response rates, 10 (22%) reported no change, and 4 (9%) reported slower rates compared with paper-based systems. Regarding the quality of responses, 25 (56%) reported no change, 12 (27%) reported improved quality, and 8 (18%) reported worse quality compared with paper-based systems.


CONCLUSIONS
Electronic systems are generally associated with an improved response rate and enhanced timeliness of responses in comparison with paper-based systems, without adversely affecting the quality of responses.
Boiselle
Phillip M
PM
Department of Radiology, Beth Israel Deaconess Medical Center, Boston, MA 02215, USA. pboisell@caregroup.harvard.edu
Mainiero
Martha B
MB
D003205:Computing Methodologies; D004521:Educational Measurement / Q000379:methods* / Q000706:statistics & numerical data*; D007396:Internship and Residency / Q000706:statistics & numerical data*; D008486:Physician Executives / Q000706:statistics & numerical data*; D011871:Radiology / Q000458:organization & administration*; D011795:Surveys and Questionnaires; D013997:Time Factors; D014481:United States