Audit and summative assessment: a completed audit cycle.
OBJECTIVE
To develop and test a system for delivering a completed audit cycle for summative assessment of general practitioner registrars in the United Kingdom.


METHODS
A trainer-based questionnaire on criteria for a completed audit cycle, followed by two marking exercises of audit projects submitted by general practice registrars.


METHODS
Training practices in the West of Scotland between 1997 and 1998.


METHODS
Trainers and registrars in the above practices.


RESULTS
116 (89%) agreed that two collections of data were an essential or desirable part of an audit project. All 57 registrars who started in August 1997 successfully completed an audit cycle, seven (12%) after resubmission. Using two rather than three independent assessors to screen the projects, the marking instrument was shown to have a sensitivity of 95% (95% confidence interval (CI) +/-3.9%) and a specificity of 77% (95% CI +/-7.5%). All assessors found the new system easier to mark and 47 registrars (87%) found completing an audit cycle as or easier than expected.


CONCLUSIONS
Evidence from the pilot project has shown that a general practice registrar's ability to review and critically analyse a piece of his/her work, with appropriate management of any necessary change, can be tested feasibly by means of a completed audit cycle within the registrar year. The process retains adequate levels of sensitivity and specificity and requires fewer assessors for marking the projects.
Lough
J R
JR
Department of Postgraduate Medical Education, University of Glasgow, Glasgow, UK.
Murray
T S
TS
D002983:Clinical Competence / Q000592:standards*; D004521:Educational Measurement / Q000379:methods; D005194:Family Practice / Q000193:education / Q000592:standards*; D006801:Humans; D008485:Medical Audit; D011795:Surveys and Questionnaires; D006113:United Kingdom