title: Observer variability and the performance between faculties and residents: US criteria for benign and malignant thyroid nodules.
abstract: OBJECTIVE
  To evaluate the interobserver variability and performance in the interpretation of ultrasonographic (US) findings of thyroid nodules.
  
  
  METHODS
  72 malignant nodules and 61 benign nodules were enrolled as part of this study. Five faculty radiologists and four residents independently performed a retrospective analysis of the US images. The observers received one training session after the first interpretation and then performed a secondary interpretation. Agreement was analyzed by Cohen's kappa statistic. Degree of performance was analyzed using receiver operating characteristic (ROC) curves.
  
  
  RESULTS
  Agreement between the faculties was fair-to-good for all criteria; however, between residents, agreement was poor-to-fair. The area under the ROC curves was 0.72, 0.62, and 0.60 for the faculties, senior residents, and junior residents, respectively. There was a significant difference in performance between the faculties and the residents (p < 0.05). There was a significant increase in the agreement for some criteria in the faculties and the senior residents after the training session, but no significant increase in the junior residents.
  
  
  CONCLUSIONS
  Independent reporting of thyroid US performed by residents is undesirable. A continuous and specialized resident training is essential to enhance the degree of agreement and performance.
authors.affiliation: Department of Radiology, College of Medicine, The Catholic University of Korea, Seoul 137-701, Korea.
authors.forename: Sung Hun
authors.initials: SH
authors.lastname: Kim
authors.forename: Chang Suk
authors.initials: CS
authors.lastname: Park
authors.forename: So Lyung
authors.initials: SL
authors.lastname: Jung
authors.forename: Bong Joo
authors.initials: BJ
authors.lastname: Kang
authors.forename: Jee Young
authors.initials: JY
authors.lastname: Kim
authors.forename: Jae Jung
authors.initials: JJ
authors.lastname: Choi
authors.forename: Ye Il
authors.initials: YI
authors.lastname: Kim
authors.forename: Jin Kyung
authors.initials: JK
authors.lastname: Oh
authors.forename: Jung Suk
authors.initials: JS
authors.lastname: Oh
authors.forename: Hanna
authors.initials: H
authors.lastname: Kim
authors.forename: Seung Hee
authors.initials: SH
authors.lastname: Jeong
authors.forename: Hyeon Woo
authors.initials: HW
authors.lastname: Yim
mesh_terms: D000328:Adult; D000368:Aged; D002983:Clinical Competence / Q000706:statistics & numerical data*; D003937:Diagnosis, Differential; D005180:Faculty, Medical / Q000706:statistics & numerical data*; D005260:Female; D006801:Humans; D007396:Internship and Residency / Q000706:statistics & numerical data*; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D012372:ROC Curve; D011871:Radiology / Q000193:education; D012189:Retrospective Studies; D012680:Sensitivity and Specificity; D013961:Thyroid Gland / Q000000981:diagnostic imaging; D013964:Thyroid Neoplasms / Q000000981:diagnostic imaging*; D014463:Ultrasonography