title: Combined rule extraction and feature elimination in supervised classification.
abstract: There are a vast number of biology related research problems involving a combination of multiple sources of data to achieve a better understanding of the underlying problems. It is important to select and interpret the most important information from these sources. Thus it will be beneficial to have a good algorithm to simultaneously extract rules and select features for better interpretation of the predictive model. We propose an efficient algorithm, Combined Rule Extraction and Feature Elimination (CRF), based on 1-norm regularized random forests. CRF simultaneously extracts a small number of rules generated by random forests and selects important features. We applied CRF to several drug activity prediction and microarray data sets. CRF is capable of producing performance comparable with state-of-the-art prediction algorithms using a small number of decision rules. Some of the decision rules are biologically significant.
authors.affiliation: Department of Computer and Information Science, University of Mississippi, University, MS 38677, USA. sliu@olemiss.edu
authors.forename: Sheng
authors.initials: S
authors.lastname: Liu
authors.forename: Ronak Y
authors.initials: RY
authors.lastname: Patel
authors.forename: Pankaj R
authors.initials: PR
authors.lastname: Daga
authors.forename: Haining
authors.initials: H
authors.lastname: Liu
authors.forename: Gang
authors.initials: G
authors.lastname: Fu
authors.forename: Robert J
authors.initials: RJ
authors.lastname: Doerksen
authors.forename: Yixin
authors.initials: Y
authors.lastname: Chen
authors.forename: Dawn E
authors.initials: DE
authors.lastname: Wilkins
mesh_terms: D020168:ATP Binding Cassette Transporter, Subfamily B, Member 1 / Q000235:genetics; D000465:Algorithms; D001185:Artificial Intelligence; D019295:Computational Biology / Q000379:methods*; D016208:Databases, Factual; D003663:Decision Trees; D006801:Humans; D008962:Models, Theoretical; D009369:Neoplasms / Q000235:genetics; D020411:Oligonucleotide Array Sequence Analysis; D043882:Receptors, Cannabinoid / Q000235:genetics; D015203:Reproducibility of Results
chemical_list: D020168:ATP Binding Cassette Transporter, Subfamily B, Member 1; D043882:Receptors, Cannabinoid