First-trimester fetal nasal bone audit: evaluation of a novel method of image assessment.
OBJECTIVE
Absence of the nasal bone has been recognized to be a strong ultrasound marker for Down syndrome and its inclusion in combined first-trimester screening would increase the sensitivity and specificity of this test. We describe the development of a method of image scoring that should allow reliable assessment of practitioners submitting themselves to peer review for nasal bone imaging.


METHODS
Twenty sonographers submitted 20 images demonstrating the presence of the nasal bone for quality assurance audit. Image quality was compared with the criteria described by The Fetal Medicine Foundation. Three raters scored the images on four separate occasions. On the first two occasions all 400 images were assessed qualitatively and given a simple pass/fail score. On the third and fourth occasions, five images from each of the 20 sets were scored objectively for five criteria by each of the three raters, with a cut-off applied to the scores generated. The reliability of these image assessment techniques was compared statistically.


RESULTS
Through quantitative assessment, 84% of images were judged in the same manner by three raters on two separate occasions and in 94% of cases five of these six ratings drew the same conclusion. Rates of intrarater and inter-rater agreement were significantly better using quantitative rather than qualitative techniques.


CONCLUSIONS
This study has shown that clearly defined assessment criteria together with a quantitative scoring method improve the reliability of expert peer review. The quantitative method is recommended as the basis for future nasal bone image audit.
McLennan
A
A
Sydney Ultrasound for Women, NSW, Australia. andrew.mclennan@sufw.com.au
Schluter
P J
PJ
Pincham
V
V
Hyett
J
J
D000465:Algorithms; D004314:Down Syndrome / Q000000981:diagnostic imaging*; D005260:Female; D005865:Gestational Age; D006801:Humans; D008485:Medical Audit; D009295:Nasal Bone / Q000002:abnormalities / Q000000981:diagnostic imaging* / Q000196:embryology; D010380:Peer Review; D011247:Pregnancy; D011261:Pregnancy Trimester, First; D012680:Sensitivity and Specificity; D016216:Ultrasonography, Prenatal / Q000592:standards*