A new descriptor selection scheme for SVM in unbalanced class problem: a case study using skin sensitisation dataset.
A novel descriptor selection scheme for Support Vector Machine (SVM) classification method has been proposed and its utility demonstrated using a skin sensitisation dataset as an example. A backward elimination procedure, guided by mean accuracy (the average of specificity and sensitivity) of a leave-one-out cross validation, is devised for the SVM. Subsets of descriptors were first selected using a sequential t-test filter or a Random Forest filter, before backward elimination was applied. Different kernels for SVM were compared using this descriptor selection scheme. The Radial Basis Function (RBF) kernel worked best when a sequential t-test filter was adopted. The highest mean accuracy, 84.9%, was obtained using SVM with 23 descriptors. The sensitivity and the specificity were as high as 93.1% and 76.6%, respectively. A linear kernel was found to be optimal when a Random Forest filter was used. The performance using 24 descriptors was comparable with a RBF kernel with a sequential t-test filter. As a comparison, Fisher's linear discriminant analysis (LDA) under the same descriptor selection scheme was carried out. SVM was shown to outperform the LDA.
Li
S
S
Health Effects Laboratory Division, National Institute for Occupational Safety and Health, Morgantown, WV 26505, USA. sw14@cdc.gov
Fedorowicz
A
A
Andrew
M E
ME
D001185:Artificial Intelligence; D017449:Dermatitis, Allergic Contact / Q000175:diagnosis; D023441:Local Lymph Node Assay; D008956:Models, Chemical; D021281:Quantitative Structure-Activity Relationship; D012680:Sensitivity and Specificity; D012984:Software