title: Kernel optimization in discriminant analysis.
abstract: Kernel mapping is one of the most used approaches to intrinsically derive nonlinear classifiers. The idea is to use a kernel function which maps the original nonlinearly separable problem to a space of intrinsically larger dimensionality where the classes are linearly separable. A major problem in the design of kernel methods is to find the kernel parameters that make the problem linear in the mapped representation. This paper derives the first criterion that specifically aims to find a kernel representation where the Bayes classifier becomes linear. We illustrate how this result can be successfully applied in several kernel discriminant analysis algorithms. Experimental results, using a large number of databases and classifiers, demonstrate the utility of the proposed approach. The paper also shows (theoretically and experimentally) that a kernel version of Subclass Discriminant Analysis yields the highest recognition rates.
authors.affiliation: Department of Electrical and Computer Engineering, The Ohio State University, Columbus, 43210, USA. youd@ece.osu.edu
authors.forename: Di
authors.initials: D
authors.lastname: You
authors.forename: Onur C
authors.initials: OC
authors.lastname: Hamsici
authors.forename: Aleix M
authors.initials: AM
authors.lastname: Martinez
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D001499:Bayes Theorem; D003198:Computer Simulation; D016208:Databases, Factual; D016002:Discriminant Analysis; D017709:Fractals; D007090:Image Interpretation, Computer-Assisted / Q000295:instrumentation*; D015233:Models, Statistical; D017711:Nonlinear Dynamics; D010363:Pattern Recognition, Automated / Q000379:methods*; D012984:Software
references.citation: Neural Comput. 2000 Oct;12(10):2385-404
references.pmid: 11032039
references.citation: IEEE Trans Pattern Anal Mach Intell. 2009 Jun;31(6):1140-6
references.pmid: 19372616
references.citation: IEEE Trans Pattern Anal Mach Intell. 2005 Dec;27(12):1934-44
references.pmid: 16358412
references.citation: IEEE Trans Neural Netw. 2008 Jan;19(1):148-57
references.pmid: 18269946
references.citation: IEEE Trans Pattern Anal Mach Intell. 2004 Jun;26(6):732-9
references.pmid: 18579934
references.citation: IEEE Trans Pattern Anal Mach Intell. 1983 Jun;5(6):671-8
references.pmid: 21869158
references.citation: IEEE Trans Pattern Anal Mach Intell. 2009 Nov;31(11):1985-99
references.pmid: 19762926
references.citation: IEEE Trans Pattern Anal Mach Intell. 2005 Feb;27(2):230-44
references.pmid: 15688560
references.citation: IEEE Trans Neural Netw. 2008 Dec;19(12):2116-31
references.pmid: 19054735
references.citation: IEEE Trans Pattern Anal Mach Intell. 2008 Apr;30(4):647-57
references.pmid: 18276970
references.citation: IEEE Trans Pattern Anal Mach Intell. 2006 Aug;28(8):1274-86
references.pmid: 16886863
references.citation: Pattern Recognit. 2008 Nov;41(11):3436-3441
references.pmid: 19884951