Selecting subsets of newly extracted features from PCA and PLS in microarray data analysis.
BACKGROUND
Dimension reduction is a critical issue in the analysis of microarray data, because the high dimensionality of gene expression microarray data set hurts generalization performance of classifiers. It consists of two types of methods, i.e. feature selection and feature extraction. Principle component analysis (PCA) and partial least squares (PLS) are two frequently used feature extraction methods, and in the previous works, the top several components of PCA or PLS are selected for modeling according to the descending order of eigenvalues. While in this paper, we prove that not all the top features are useful, but features should be selected from all the components by feature selection methods.


RESULTS
We demonstrate a framework for selecting feature subsets from all the newly extracted components, leading to reduced classification error rates on the gene expression microarray data. Here we have considered both an unsupervised method PCA and a supervised method PLS for extracting new components, genetic algorithms for feature selection, and support vector machines and k nearest neighbor for classification. Experimental results illustrate that our proposed framework is effective to select feature subsets and to reduce classification error rates.


CONCLUSIONS
Not only the top features newly extracted by PCA or PLS are important, therefore, feature selection should be performed to select subsets from new features to improve generalization performance of classifiers.
Li
Guo-Zheng
GZ
Department of Control Science & Engineering, Tongji University, Shanghai 201804, PR China. drgzli@gmail.com
Bu
Hua-Long
HL
Yang
Mary Qu
MQ
Zeng
Xue-Qiang
XQ
Yang
Jack Y
JY
D000465:Algorithms; D019295:Computational Biology / Q000379:methods; D020869:Gene Expression Profiling / Q000379:methods*; D006801:Humans; D016018:Least-Squares Analysis; D015233:Models, Statistical; D009369:Neoplasms / Q000145:classification* / Q000235:genetics; D020411:Oligonucleotide Array Sequence Analysis / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods; D025341:Principal Component Analysis