title: Deep Feature Selection: Theory and Application to Identify Enhancers and Promoters.
abstract: Sparse linear models approximate target variable(s) by a sparse linear combination of input variables. Since they are simple, fast, and able to select features, they are widely used in classification and regression. Essentially they are shallow feed-forward neural networks that have three limitations: (1) incompatibility to model nonlinearity of features, (2) inability to learn high-level features, and (3) unnatural extensions to select features in a multiclass case. Deep neural networks are models structured by multiple hidden layers with nonlinear activation functions. Compared with linear models, they have two distinctive strengths: the capability to (1) model complex systems with nonlinear structures and (2) learn high-level representation of features. Deep learning has been applied in many large and complex systems where deep models significantly outperform shallow ones. However, feature selection at the input level, which is very helpful to understand the nature of a complex system, is still not well studied. In genome research, the cis-regulatory elements in noncoding DNA sequences play a key role in the expression of genes. Since the activity of regulatory elements involves highly interactive factors, a deep tool is strongly needed to discover informative features. In order to address the above limitations of shallow and deep models for selecting features of a complex system, we propose a deep feature selection (DFS) model that (1) takes advantages of deep structures to model nonlinearity and (2) conveniently selects a subset of features right at the input level for multiclass data. Simulation experiments convince us that this model is able to correctly identify both linear and nonlinear features. We applied this model to the identification of active enhancers and promoters by integrating multiple sources of genomic information. Results show that our model outperforms elastic net in terms of size of discriminative feature subset and classification accuracy.
authors.affiliation: 1 Information and Communications Technologies, National Research Council of Canada , Ottawa, Ontario, Canada .|2 Centre for Molecular Medicine and Therapeutics, Child and Family Research Institute, BC Children's Hospital, University of British Columbia , Vancouver, British Columbia, Canada .
authors.forename: Yifeng
authors.initials: Y
authors.lastname: Li
authors.affiliation: 2 Centre for Molecular Medicine and Therapeutics, Child and Family Research Institute, BC Children's Hospital, University of British Columbia , Vancouver, British Columbia, Canada .
authors.forename: Chih-Yu
authors.initials: CY
authors.lastname: Chen
authors.affiliation: 2 Centre for Molecular Medicine and Therapeutics, Child and Family Research Institute, BC Children's Hospital, University of British Columbia , Vancouver, British Columbia, Canada .
authors.forename: Wyeth W
authors.initials: WW
authors.lastname: Wasserman
mesh_terms: D000465:Algorithms; D003198:Computer Simulation; D004742:Enhancer Elements, Genetic; D006801:Humans; D016571:Neural Networks, Computer; D017711:Nonlinear Dynamics; D011401:Promoter Regions, Genetic
keywords: deep feature selection; deep learning; enhancer; promoter