title: Adequacy testing of training set sample sizes in the development of a computer-assisted diagnosis scheme.
abstract: OBJECTIVE
  The authors assessed the performance changes of a computer-assisted diagnosis (CAD) scheme as a function of the number of regions used for training (rule-setting).
  
  
  METHODS
  One hundred twenty regions depicting actual masses and 400 suspicious but actually negative regions were selected as a testing data set from a database of 2,146 regions identified as suspicious on 618 mammograms. An artificial neural network using 24 and 16 region-based features as input neurons was applied to classify the regions as positive or negative for the presence of a mass. CAD scheme performance was evaluated on the testing data set as the number of regions used for training increased from 60 to 496.
  
  
  RESULTS
  As the number of regions in the training sets increased, the results decreased and plateaued beyond a sample size of approximately 200 regions. Performance with the testing data set continued to improve as the training data set increased in size.
  
  
  CONCLUSIONS
  A trend in a system's performance as a function of training set size can be used to assess adequacy of the training data set in the development of a CAD scheme.
authors.affiliation: Department of Radiology, University of Pittsburgh, PA 15261-0001, USA.
authors.forename: B
authors.initials: B
authors.lastname: Zheng
authors.forename: Y H
authors.initials: YH
authors.lastname: Chang
authors.forename: W F
authors.initials: WF
authors.lastname: Good
authors.forename: D
authors.initials: D
authors.lastname: Gur
mesh_terms: D001943:Breast Neoplasms / Q000000981:diagnostic imaging / Q000453:epidemiology; D016208:Databases, Factual; D005069:Evaluation Studies as Topic; D005260:Female; D006801:Humans; D008327:Mammography / Q000379:methods*; D016571:Neural Networks, Computer; D011856:Radiographic Image Enhancement; D011857:Radiographic Image Interpretation, Computer-Assisted