title: Computer aid for decision to biopsy breast masses on mammography: validation on new cases.
abstract: OBJECTIVE
  The purpose of this study was to validate the performance of a previously developed computer aid for breast mass classification for mammography on a new, independent database of cases not used for algorithm development.
  
  
  METHODS
  A computer aid (classifier) based on the likelihood ratio (LRb) was previously developed on a database of 670 mass cases. The 670 cases (245 malignant) from one medical institution were described using 16 features from the American College of Radiology Breast Imaging-Reporting and Data System lexicon and patient history findings. A separate database of 151 (43 malignant) validation cases were collected that were previously unseen by the classifier. These new validation cases were evaluated by the classifier without retraining. Performance evaluation methods included Receiver Operating Characteristic (ROC), round-robin, and leave-one-out bootstrap sampling.
  
  
  RESULTS
  The performance of the classifier on the training data yielded an average ROC area of 0.90 +/- 0.02 and partial ROC area (0.90AUC) of 0.60 +/- 0.06. The exact nonparametric performance on the validation set of 151 cases yielded a ROC area of 0.88 and 0.90AUC of 0.57. Using a 100% sensitivity cutoff threshold established on the training data (100% negative predictive value), the classifier correctly identified 100% of the malignant masses in the validation test set, while potentially obviating 26% of the biopsies performed on benign masses.
  
  
  CONCLUSIONS
  The LRb classifier performed consistently on new data that was not used for classifier development. The LRb classifier shows promise as a potential aid in reducing the number of biopsies performed on benign masses.
authors.affiliation: Duke Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, DUMC 2623, Durham, NC 27710, USA. anya.bilska@duke.edu
authors.forename: Anna O
authors.initials: AO
authors.lastname: Bilska-Wolak
authors.forename: Carey E
authors.initials: CE
authors.lastname: Floyd
authors.forename: Joseph Y
authors.initials: JY
authors.lastname: Lo
authors.forename: Jay A
authors.initials: JA
authors.lastname: Baker
mesh_terms: D001706:Biopsy; D001941:Breast Diseases / Q000145:classification* / Q000000981:diagnostic imaging; D020000:Decision Support Systems, Clinical; D005260:Female; D006801:Humans; D016013:Likelihood Functions; D008327:Mammography; D010363:Pattern Recognition, Automated; D012372:ROC Curve; D011857:Radiographic Image Interpretation, Computer-Assisted; D012680:Sensitivity and Specificity