title: The diagnostic accuracy/efficacy of MRI in differentiating hepatic hemangiomas from metastatic colorectal/breast carcinoma: a multiple reader ROC analysis using a jackknife technique.
abstract: OBJECTIVE
  Our purpose was to determine the diagnostic accuracy efficacy of a simple MR technique in differentiating hepatic hemangiomas from colorectal or breast metastases using a multiple reader method.
  
  
  METHODS
  Thirty-seven cases with confirmed hepatic hemangiomas and 115 with confirmed hepatic metastases (colon primary, n = 86; breast primary, n = 29) evaluated with MRI at 1.5 T were retrospectively collected. A single lesion in a single slice from each patient was randomly selected; the images were masked and then were interpreted in random order by five separate readers blinded to the diagnosis using a five point diagnostic scale (from definite hemangioma to definite metastasis). Morphologic characteristics of lesion margin, signal intensity relative to other structures, and internal architecture (homogeneous versus heterogeneous) were also assessed independently of the five point diagnostic scale. Three of the readers had > 8 years of experience, while the other two had 1 and 3 years. The diagnostic scale results were subjected to receiver operating characteristic (ROC) analysis using a jackknife method. kappa-Statistics were applied to assess interreader agreement in the morphologic characteristics. A logistic regression model was used to determine which characteristics predicted pathology and reader diagnosis.
  
  
  RESULTS
  ROC analysis showed the average area under the curve over all readers was (0.91 (0.89-0.93 95% confidence interval) (p < 0.0001). An analysis of variance showed no significant difference between the areas under the curves of each reader (p = 0.6433). When the definite and probable categories for hemangioma and metastasis were combined, the sensitivity/specificity for the diagnosis of hemangioma ranged from 57 to 73%/91 to 97%. The positive/negative predictive value ranged from 72 to 84%/87 to 91%. For the morphologic assessment, there was significant agreement between the readers (p < 0.0001-0.0037). A sharp margin and lesion signal equal to or greater than CSF predicted the presence of a hemangioma (p = 0.0148 and p < 0.0001, respectively). A sharp margin, lesion signal equal to or greater than CSF, and a homogeneous internal architecture all predicted the reader diagnosis of definitely or probably hemangioma.
  
  
  CONCLUSIONS
  For multiple readers, T2-weighted SE MRI alone is a very specific method for distinguishing hemangiomas from metastatic colon or breast carcinoma. Morphologic characteristics of a sharp margin and a high signal predict the presence of a hemangioma. Last, reader experience does not appear to have a significant effect on the specificity.
authors.affiliation: Department of Radiology, Duke University Medical Center, Durham, NC, USA.
authors.forename: M G
authors.initials: MG
authors.lastname: Lee
authors.forename: M E
authors.initials: ME
authors.lastname: Baker
authors.forename: H D
authors.initials: HD
authors.lastname: Sostman
authors.forename: C E
authors.initials: CE
authors.lastname: Spritzer
authors.forename: S
authors.initials: S
authors.lastname: Paine
authors.forename: E K
authors.initials: EK
authors.lastname: Paulson
authors.forename: M T
authors.initials: MT
authors.lastname: Keogan
mesh_terms: D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D000704:Analysis of Variance; D001943:Breast Neoplasms / Q000473:pathology*; D015179:Colorectal Neoplasms / Q000473:pathology*; D003937:Diagnosis, Differential; D005260:Female; D006391:Hemangioma / Q000175:diagnosis*; D006801:Humans; D008113:Liver Neoplasms / Q000175:diagnosis* / Q000556:secondary*; D016015:Logistic Models; D008279:Magnetic Resonance Imaging / Q000295:instrumentation / Q000379:methods* / Q000706:statistics & numerical data; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D012372:ROC Curve; D015203:Reproducibility of Results