Kernel optimization in discriminant analysis.
Kernel mapping is one of the most used approaches to intrinsically derive nonlinear classifiers. The idea is to use a kernel function which maps the original nonlinearly separable problem to a space of intrinsically larger dimensionality where the classes are linearly separable. A major problem in the design of kernel methods is to find the kernel parameters that make the problem linear in the mapped representation. This paper derives the first criterion that specifically aims to find a kernel representation where the Bayes classifier becomes linear. We illustrate how this result can be successfully applied in several kernel discriminant analysis algorithms. Experimental results, using a large number of databases and classifiers, demonstrate the utility of the proposed approach. The paper also shows (theoretically and experimentally) that a kernel version of Subclass Discriminant Analysis yields the highest recognition rates.
You
Di
D
Department of Electrical and Computer Engineering, The Ohio State University, Columbus, 43210, USA. youd@ece.osu.edu
Hamsici
Onur C
OC
Martinez
Aleix M
AM
D000465:Algorithms; D001185:Artificial Intelligence; D001499:Bayes Theorem; D003198:Computer Simulation; D016208:Databases, Factual; D016002:Discriminant Analysis; D017709:Fractals; D007090:Image Interpretation, Computer-Assisted / Q000295:instrumentation*; D015233:Models, Statistical; D017711:Nonlinear Dynamics; D010363:Pattern Recognition, Automated / Q000379:methods*; D012984:Software
Neural Comput. 2000 Oct;12(10):2385-404
11032039
IEEE Trans Pattern Anal Mach Intell. 2009 Jun;31(6):1140-6
19372616
IEEE Trans Pattern Anal Mach Intell. 2005 Dec;27(12):1934-44
16358412
IEEE Trans Neural Netw. 2008 Jan;19(1):148-57
18269946
IEEE Trans Pattern Anal Mach Intell. 2004 Jun;26(6):732-9
18579934
IEEE Trans Pattern Anal Mach Intell. 1983 Jun;5(6):671-8
21869158
IEEE Trans Pattern Anal Mach Intell. 2009 Nov;31(11):1985-99
19762926
IEEE Trans Pattern Anal Mach Intell. 2005 Feb;27(2):230-44
15688560
IEEE Trans Neural Netw. 2008 Dec;19(12):2116-31
19054735
IEEE Trans Pattern Anal Mach Intell. 2008 Apr;30(4):647-57
18276970
IEEE Trans Pattern Anal Mach Intell. 2006 Aug;28(8):1274-86
16886863
Pattern Recognit. 2008 Nov;41(11):3436-3441
19884951