Sampling for quality assurance of grading decisions in diabetic retinopathy screening: designing the system to detect errors.
OBJECTIVE
To evaluate various designs for a quality assurance system to detect and control human errors in a national screening programme for diabetic retinopathy.


METHODS
A computer simulation was performed of some possible ways of sampling the referral decisions made during grading and of different criteria for initiating more intensive QA investigations. The effectiveness of QA systems was assessed by the ability to detect a grader making occasional errors in referral.


RESULTS
Substantial QA sample sizes are needed to ensure against inappropriate failure to refer. Detection of a grader who failed to refer one in ten cases can be achieved with a probability of 0.58 using an annual sample size of 300 and 0.77 using a sample size of 500.


CONCLUSIONS
An unmasked verification of a sample of non-referrals by a specialist is the most effective method of internal QA for the diabetic retinopathy screening programme. Preferential sampling of those with some degree of disease may improve the efficiency of the system.
NHS Quality Improvement Scotland, Glasgow, UK.
Jim
J
Slattery
D003930:Diabetic Retinopathy / Q000175:diagnosis*; D006801:Humans; D008403:Mass Screening; D019300:Medical Errors / Q000706:statistics & numerical data*; D011785:Quality Assurance, Health Care; D012017:Referral and Consultation / Q000706:statistics & numerical data; D018401:Sample Size; D006113:United Kingdom