title: Improving the Mann-Whitney statistical test for feature selection: an approach in breast cancer diagnosis on mammography.
abstract: OBJECTIVE
  This work addresses the theoretical description and experimental evaluation of a new feature selection method (named uFilter). The uFilter improves the Mann-Whitney U-test for reducing dimensionality and ranking features in binary classification problems. Also, it presented a practical uFilter application on breast cancer computer-aided diagnosis (CADx).
  
  
  METHODS
  A total of 720 datasets (ranked subsets of features) were formed by the application of the chi-square (CHI2) discretization, information-gain (IG), one-rule (1Rule), Relief, uFilter and its theoretical basis method (named U-test). Each produced dataset was used for training feed-forward backpropagation neural network, support vector machine, linear discriminant analysis and naive Bayes machine learning algorithms to produce classification scores for further statistical comparisons.
  
  
  RESULTS
  A head-to-head comparison based on the mean of area under receiver operating characteristics curve scores against the U-test method showed that the uFilter method significantly outperformed the U-test method for almost all classification schemes (p<0.05); it was superior in 50%; tied in a 37.5% and lost in a 12.5% of the 24 comparative scenarios. Also, the performance of the uFilter method, when compared with CHI2 discretization, IG, 1Rule and Relief methods, was superior or at least statistically similar on the explored datasets while requiring less number of features.
  
  
  CONCLUSIONS
  The experimental results indicated that uFilter method statistically outperformed the U-test method and it demonstrated similar, but not superior, performance than traditional feature selection methods (CHI2 discretization, IG, 1Rule and Relief). The uFilter method revealed competitive and appealing cost-effectiveness results on selecting relevant features, as a support tool for breast cancer CADx methods especially in unbalanced datasets contexts. Finally, the redundancy analysis as a complementary step to the uFilter method provided us an effective way for finding optimal subsets of features without decreasing the classification performances.
authors.affiliation: Institute of Mechanical Engineering and Industrial Management (INEGI), Campus da FEUP, Rua Dr. Roberto Frias, 400, 4200-465 Porto, Portugal. Electronic address: nperez@inegi.up.pt.
authors.forename: Noel Pérez
authors.initials: NP
authors.lastname: Pérez
authors.affiliation: Institute of Electronics and Telematics Engineering of Aveiro, Campus Universitário de Santiago, 3810-193 Aveiro, Portugal; Institute of Mechanical Engineering and Industrial Management (INEGI), Campus da FEUP, Rua Dr. Roberto Frias, 400, 4200-465 Porto, Portugal.
authors.forename: Miguel A
authors.initials: MA
authors.lastname: Guevara López
authors.affiliation: Institute of Electronics and Telematics Engineering of Aveiro, Campus Universitário de Santiago, 3810-193 Aveiro, Portugal.
authors.forename: Augusto
authors.initials: A
authors.lastname: Silva
authors.affiliation: Faculty of Medicine - Centro Hospitalar São Joao, Al. Prof. Hernâni Monteiro, 4200-319 Porto, Portugal.
authors.forename: Isabel
authors.initials: I
authors.lastname: Ramos
mesh_terms: D000465:Algorithms; D001499:Bayes Theorem; D001943:Breast Neoplasms / Q000000981:diagnostic imaging*; D016009:Chi-Square Distribution; D016208:Databases, Factual; D003936:Diagnosis, Computer-Assisted / Q000379:methods*; D016002:Discriminant Analysis; D005260:Female; D006801:Humans; D016014:Linear Models; D000069550:Machine Learning; D008327:Mammography / Q000379:methods*; D015233:Models, Statistical; D011237:Predictive Value of Tests; D011857:Radiographic Image Interpretation, Computer-Assisted / Q000379:methods*; D015203:Reproducibility of Results
keywords: Breast cancer CADx; Feature selection methods; Machine learning algorithms; Mann–Whitney U-test; Redundancy analysis; uFilter method