title: Parameter Selection in Mutual Information-Based Feature Selection in Automated Diagnosis of Multiple Epilepsies Using Scalp EEG.
abstract: Developing EEG-based computer aided diagnostic (CAD) tools would allow identification of epilepsy in individuals who have experienced possible seizures, yet such an algorithm requires efficient identification of meaningful features out of potentially more than 35,000 features of EEG activity. Mutual information can be used to identify a subset of minimally-redundant and maximally relevant (mRMR) features but requiresa prioriselection of two parameters: the number of features of interest and the number of quantization levels into which the continuous features are binned. Here we characterize the variance of cross-validation accuracy with respect to changes in these parameters for four classes of machine learning (ML) algorithms. This assesses the efficiency of combining mRMR with each of these algorithms by assessing when the variance of cross-validation accuracy is minimized and demonstrates how naive parameter selection may artificially depress accuracy. Our results can be used to improve the understanding of how feature selection interacts with four classes of ML algorithms and provide guidance for bettera prioriparameter selection in situations where an overwhelming number of redundant, noisy features are available for classification.
authors.affiliation: Departments of Biomathematics, Bioengineering, Psychiatry, and Urban Planning University of California, Los Angeles Los Angeles, USA.
authors.forename: Wesley T
authors.initials: WT
authors.lastname: Kerr
authors.affiliation: Departments of Biomathematics, Bioengineering, Psychiatry, and Urban Planning University of California, Los Angeles Los Angeles, USA.
authors.forename: Ariana
authors.initials: A
authors.lastname: Anderson
authors.affiliation: Departments of Biomathematics, Bioengineering, Psychiatry, and Urban Planning University of California, Los Angeles Los Angeles, USA.
authors.forename: Hongjing
authors.initials: H
authors.lastname: Xia
authors.affiliation: Departments of Biomathematics, Bioengineering, Psychiatry, and Urban Planning University of California, Los Angeles Los Angeles, USA.
authors.forename: Eric S
authors.initials: ES
authors.lastname: Braun
authors.affiliation: Departments of Biomathematics, Bioengineering, Psychiatry, and Urban Planning University of California, Los Angeles Los Angeles, USA.
authors.forename: Edward P
authors.initials: EP
authors.lastname: Lau
authors.affiliation: Departments of Biomathematics, Bioengineering, Psychiatry, and Urban Planning University of California, Los Angeles Los Angeles, USA.
authors.forename: Andrew Y
authors.initials: AY
authors.lastname: Cho
authors.affiliation: Departments of Biomathematics, Bioengineering, Psychiatry, and Urban Planning University of California, Los Angeles Los Angeles, USA.
authors.forename: Mark S
authors.initials: MS
authors.lastname: Cohen
keywords: automated diagnosis; epilepsy; feature selection; mutual information; scalp EEG