title: A new & robust information theoretic measure and its application to image alignment.
abstract: In this paper we develop a novel measure of information in a random variable based on its cumulative distribution that we dub cumulative residual entropy (CRE). This measure parallels the well known Shannon entropy but has the following advantages: (1) it is more general than the Shannon Entropy as its definition is valid in the discrete and continuous domains, (2) it possess more general mathematical properties and (3) it can be easily computed from sample data and these computations asymptotically converge to the true values. Based on CRE, we define the cross-CRE (CCRE) between two random variables, and apply it to solve the image alignment problem for parameterized (3D rigid and affine) transformations. The key strengths of the CCRE over using the mutual information (based on Shannon's entropy) are that the former has significantly larger tolerance to noise and a much larger convergence range over the field of parameterized transformations. We demonstrate these strengths via experiments on synthesized and real image data.
authors.affiliation: Department of Computer & Information Sciences & Engr, University of Florida, Gainesville, FL 32611, USA.
authors.forename: F
authors.initials: F
authors.lastname: Wang
authors.forename: B C
authors.initials: BC
authors.lastname: Vemuri
authors.forename: M
authors.initials: M
authors.lastname: Rao
authors.forename: Y
authors.initials: Y
authors.lastname: Chen
mesh_terms: D000465:Algorithms; D000818:Animals; D001921:Brain / Q000033:anatomy & histology*; D003198:Computer Simulation; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D007257:Information Theory; D008279:Magnetic Resonance Imaging / Q000379:methods*; D051379:Mice; D008954:Models, Biological; D015233:Models, Statistical; D009038:Motion; D010363:Pattern Recognition, Automated; D011786:Quality Control; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique