title: Universal entropy of word ordering across linguistic families.
abstract: BACKGROUND
  The language faculty is probably the most distinctive feature of our species, and endows us with a unique ability to exchange highly structured information. In written language, information is encoded by the concatenation of basic symbols under grammatical and semantic constraints. As is also the case in other natural information carriers, the resulting symbolic sequences show a delicate balance between order and disorder. That balance is determined by the interplay between the diversity of symbols and by their specific ordering in the sequences. Here we used entropy to quantify the contribution of different organizational levels to the overall statistical structure of language.
  
  
  RESULTS
  We computed a relative entropy measure to quantify the degree of ordering in word sequences from languages belonging to several linguistic families. While a direct estimation of the overall entropy of language yielded values that varied for the different families considered, the relative entropy quantifying word ordering presented an almost constant value for all those families.
  
  
  CONCLUSIONS
  Our results indicate that despite the differences in the structure and vocabulary of the languages analyzed, the impact of word ordering in the structure of language is a statistical linguistic universal.
authors: The University of Manchester, Manchester, United Kingdom. M.Montemurro@manchester.ac.uk
authors: Marcelo A
authors: MA
authors: Montemurro
authors: Damián H
authors: DH
authors: Zanette
references: Br Foreign Med Chir Rev. 1860 Apr;25(50):367-404
references: 30164232
references: Nature. 2008 Jun 19;453(7198):988-9
references: 18563138
references: Proc Natl Acad Sci U S A. 2006 May 23;103(21):7956-61
references: 16698933
references: Nature. 1992 Mar 12;356(6365):168-70
references: 1301010
references: Science. 2008 Feb 1;319(5863):588
references: 18239118
references: Nature. 2000 Mar 30;404(6777):495-8
references: 10761917
references: Nature. 2003 Nov 27;426(6965):435-9
references: 14647380
references: Science. 1969 Oct 24;166(3904):473-8
references: 17731897
references: Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics. 1994 Feb;49(2):1685-9
references: 9961383
references: Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics. 1995 May;51(5):5084-91
references: 9963221
references: Nature. 2002 Jun 6;417(6889):611-7
references: 12050656