title: Generalization of entropy based divergence measures for symbolic sequence analysis.
abstract: Entropy based measures have been frequently used in symbolic sequence analysis. A symmetrized and smoothed form of Kullback-Leibler divergence or relative entropy, the Jensen-Shannon divergence (JSD), is of particular interest because of its sharing properties with families of other divergence measures and its interpretability in different domains including statistical physics, information theory and mathematical statistics. The uniqueness and versatility of this measure arise because of a number of attributes including generalization to any number of probability distributions and association of weights to the distributions. Furthermore, its entropic formulation allows its generalization in different statistical frameworks, such as, non-extensive Tsallis statistics and higher order Markovian statistics. We revisit these generalizations and propose a new generalization of JSD in the integrated Tsallis and Markovian statistical framework. We show that this generalization can be interpreted in terms of mutual information. We also investigate the performance of different JSD generalizations in deconstructing chimeric DNA sequences assembled from bacterial genomes including that of E. coli, S. enterica typhi, Y. pestis and H. influenzae. Our results show that the JSD generalizations bring in more pronounced improvements when the sequences being compared are from phylogenetically proximal organisms, which are often difficult to distinguish because of their compositional similarity. While small but noticeable improvements were observed with the Tsallis statistical JSD generalization, relatively large improvements were observed with the Markovian generalization. In contrast, the proposed Tsallis-Markovian generalization yielded more pronounced improvements relative to the Tsallis and Markovian generalizations, specifically when the sequences being compared arose from phylogenetically proximal organisms.
authors.affiliation: Departamento de Ciencias Básicas, CIII - Facultad Regional Córdoba, Universidad Tecnológica Nacional, Córdoba, Argentina; Facultad de Matemática, Astronomía y Física, Universidad Nacional de Córdoba, Córdoba, Argentina.
authors.forename: Miguel A
authors.initials: MA
authors.lastname: Ré
authors.affiliation: Department of Biological Sciences, University of North Texas, Denton, Texas, United States of America; Department of Mathematics, University of North Texas, Denton, Texas, United States of America.
authors.forename: Rajeev K
authors.initials: RK
authors.lastname: Azad
mesh_terms: D019277:Entropy; D004926:Escherichia coli / Q000235:genetics; D006193:Haemophilus influenzae / Q000235:genetics; D017422:Sequence Analysis, DNA / Q000379:methods*; D015010:Yersinia pestis / Q000235:genetics
references.citation: Nucleic Acids Res. 2010 Aug;38(15):e158
references.pmid: 20571085
references.citation: Phys Rev E Stat Nonlin Soft Matter Phys. 2002 Apr;65(4 Pt 1):041905
references.pmid: 12005871
references.citation: Nucleic Acids Res. 2007;35(14):4629-39
references.pmid: 17591616
references.citation: Phys Rev E Stat Nonlin Soft Matter Phys. 2011 Mar;83(3 Pt 1):031908
references.pmid: 21517526
references.citation: Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics. 1996 May;53(5):5181-5189
references.pmid: 9964850
references.citation: Nucleic Acids Res. 2013 Jan 7;41(1):e23
references.pmid: 23036836
references.citation: Phys Rev E Stat Nonlin Soft Matter Phys. 2002 May;65(5 Pt 1):051909
references.pmid: 12059595
references.citation: Nature. 2000 May 18;405(6784):299-304
references.pmid: 10830951
references.citation: Phys Rev E Stat Nonlin Soft Matter Phys. 2002 Sep;66(3 Pt 1):031913
references.pmid: 12366158
references.citation: Nucleic Acids Res. 2009 Sep;37(16):5255-66
references.pmid: 19589805
references.citation: Gene. 2001 Oct 3;276(1-2):57-72
references.pmid: 11591472
references.citation: Phys Rev E Stat Nonlin Soft Matter Phys. 2007 Jan;75(1 Pt 1):011915
references.pmid: 17358192