Good-Turing frequency estimation in a finite population.
Good-Turing frequency estimation (Good, ) is a simple, effective method for predicting detection probabilities of objects of both observed and unobserved classes based on observed frequencies of classes in a sample. The method has been used widely in several disciplines, such as information retrieval, computational linguistics, text recognition, and ecological diversity estimation. Nevertheless, existing studies assume sampling with replacement or sampling from an infinite population, which might be inappropriate for many practical applications. In light of this limitation, this article presents a modification of the Good-Turing estimation method to account for finite population sampling. We provide three practical extensions of the modified method, and we examine performance of the modified method and its extensions in simulation experiments.
Institute of Statistics and Department of Applied Mathematics, National Chung Hsing University, Taichung 40227, Taiwan.
Wen-Han
WH
Hwang
Chih-Wei
CW
Lin
Tsung-Jen
TJ
Shen
D010944:Plants; D011336:Probability; D018401:Sample Size; D013223:Statistics as Topic / Q000379:methods*
Finite population; Frequency estimation; Good-Turing; Number-of-classes estimation; Sample coverage; Shannon index