title: Calculations of population differentiation based on GST and D: forget GST but not all of statistics!
abstract: G(ST)-values and its relatives (F(ST)) belong to the most used parameters to define genetic differences between populations. Originally, they were developed for allozymes with very low number of alleles. Using highly polymorphic microsatellite markers it was often puzzling that G(ST)-values were very low but statistically significant. In their papers, Jost (2008) and Hedrick (2005) explained that G(ST)-values do not show genetic differentiation, and Jost suggested calculating D-values instead. Theoretical mathematical considerations are often difficult to follow; therefore, we chose an applied approach comparing two artificial populations with different number of alleles at equal frequencies and known genetic divergence. Our results show that even for more than one allele per population G(ST)-values do not calculate population differentiation correctly; in contrast, D-values do reflect the genetic differentiation indicating that data based on G(ST)-values need to be re-evaluated. In our approach, statistical evaluations remained similar. We provide information about the impact of different sample sizes on D-values in relation to number of alleles and genetic divergence.
authors.affiliation: Institute of Biology and Environmental Sciences, Carl von Ossietzky University Oldenburg, Oldenburg, Germany. gabriele.gerlach@uni-oldenburg.de
authors.forename: Gabriele
authors.initials: G
authors.lastname: Gerlach
authors.forename: Alexander
authors.initials: A
authors.lastname: Jueterbock
authors.forename: Philipp
authors.initials: P
authors.lastname: Kraemer
authors.forename: Jana
authors.initials: J
authors.lastname: Deppermann
authors.forename: Peter
authors.initials: P
authors.lastname: Harmand
mesh_terms: D005787:Gene Frequency; D014644:Genetic Variation; D005828:Genetics, Population; D008957:Models, Genetic; D015233:Models, Statistical