title: Coalescent process with fluctuating population size and its effective size.
abstract: We consider a Wright-Fisher model whose population size is a finite Markov chain. We introduce a sequence of two-dimensional discrete time Markov chains whose components describe the coalescent process and the fluctuation of population size. For the limiting process of the sequence of Markov chains, the relationship of the expectation of coalescence time to the harmonic and the arithmetic means of population sizes is shown, and the Laplace transform of the distribution of coalescence time is calculated. We define the coalescence effective population size (cEPS) by the expectation of coalescence time. We show that cEPS is strictly larger (resp. smaller) than the harmonic (resp. arithmetic) mean. As the population size fluctuates more quickly (resp. slowly), cEPS is closer to the harmonic (resp. arithmetic) mean. For the case of a two-valued Markov chain, we show the explicit expression of cEPS and its dependency on the sample size.
authors.affiliation: Department of Biology, Graduate School of Sciences, Kyushu University, 4-2-1 Ropponmatsu, Chuo-ku, Fukuoka 810-8560, Japan. sanorcb@mbox.nc.kyushu-u-ac.jp
authors.forename: Akinori
authors.initials: A
authors.lastname: Sano
authors.forename: Akinobu
authors.initials: A
authors.lastname: Shimizu
authors.forename: Masaru
authors.initials: M
authors.lastname: Iizuka
mesh_terms: D005828:Genetics, Population; D006801:Humans; D008390:Markov Chains; D008962:Models, Theoretical; D011156:Population Density