title: Unbalanced sample size effect on genome-wide population differentiation studies.
abstract: The fixation index (F(ST)) is one of the most widely used measurements of genetic distance between populations. The data set from the international HapMap project has been served as a reference data set for population differentiation studies. F(ST) is commonly used in order to compare the sample data with HapMap data. In this study, however, we show that the use of F(ST) without consideration of sample sizes may mislead the result. In particular, we first demonstrate that F(ST) suffers from imbalance of sample sizes through simulation studies and through the analysis of a large scale Korean genome-wide association data. Then, we propose a modified version of F(ST) which is shown to be more robust to imbalance of sample size. In addition, the chi-square test commonly used for homogeneity test is shown to perform similarly to the modified version of F(ST).
authors.affiliation: Department of Statistics, Seoul National University, Gwanak-gu, Seoul 151-747, Korea. snu.kyunghee@gmail.com
authors.forename: Kyunghee
authors.initials: K
authors.lastname: Han
authors.forename: Kyee-Zu
authors.initials: KZ
authors.lastname: Kim
authors.forename: Jung Mi
authors.initials: JM
authors.lastname: Oh
authors.forename: In-Wha
authors.initials: IW
authors.lastname: Kim
authors.forename: Kyungim
authors.initials: K
authors.lastname: Kim
authors.forename: Taesung
authors.initials: T
authors.lastname: Park
mesh_terms: D019143:Evolution, Molecular; D014644:Genetic Variation; D015894:Genome, Human; D055106:Genome-Wide Association Study / Q000379:methods*; D023281:Genomics / Q000379:methods; D060148:HapMap Project; D006801:Humans; D012107:Research Design; D018401:Sample Size