title: Exploring empirical rank-frequency distributions longitudinally through a simple stochastic process.
abstract: The frequent appearance of empirical rank-frequency laws, such as Zipf's law, in a wide range of domains reinforces the importance of understanding and modeling these laws and rank-frequency distributions in general. In this spirit, we utilize a simple stochastic cascade process to simulate several empirical rank-frequency distributions longitudinally. We focus especially on limiting the process's complexity to increase accessibility for non-experts in mathematics. The process provides a good fit for many empirical distributions because the stochastic multiplicative nature of the process leads to an often observed concave rank-frequency distribution (on a log-log scale) and the finiteness of the cascade replicates real-world finite size effects. Furthermore, we show that repeated trials of the process can roughly simulate the longitudinal variation of empirical ranks. However, we find that the empirical variation is often less that the average simulated process variation, likely due to longitudinal dependencies in the empirical datasets. Finally, we discuss the process limitations and practical applications.
authors.affiliation: Department of Communications and Networking, Aalto University, Espoo, Finland.
authors.forename: Benjamin J
authors.initials: BJ
authors.lastname: Finley
authors.affiliation: Department of Communications and Networking, Aalto University, Espoo, Finland.
authors.forename: Kalevi
authors.initials: K
authors.lastname: Kilkki
mesh_terms: D001877:Books; D003132:Commerce; D003198:Computer Simulation; D019992:Databases as Topic; D036262:Empirical Research; D005602:France; D009040:Motion Pictures / Q000191:economics; D016008:Statistical Distributions; D013269:Stochastic Processes; D014481:United States
references.citation: Phys Rev E Stat Nonlin Soft Matter Phys. 2006 Sep;74(3 Pt 2):036116
references.pmid: 17025717
references.citation: PLoS One. 2009;4(3):e4791
references.pmid: 19277122
references.citation: Science. 2012 Feb 10;335(6069):665-6
references.pmid: 22323807