title: Avoiding pitfalls in estimating heritability with the common options approach.
abstract: In many circumstances, heritability estimates are subject to two potentially interacting pitfalls: the spatial and the regression to the mean (RTM) fallacies. The spatial fallacy occurs when the set of potential movement options differs among individuals according to where individuals depart. The RTM fallacy occurs when extreme measurements are followed by measurements that are closer to the mean. We simulated data from the largest published heritability study of a behavioural trait, colony size choice, to examine the operation of the two fallacies. We found that spurious heritabilities are generated under a wide range of conditions both in experimental and correlative estimates of heritability. Classically designed cross-foster experiments can actually increase the frequency of spurious heritabilities. Simulations showed that experiments providing all individuals with the identical set of options, such as by fostering all offspring in the same breeding location, are immune to the two pitfalls.
authors.affiliation: 1] CNRS, UPS, ENFA; EDB (Laboratoire Evolution & Diversité Biologique); UMR5174; 118 route de Narbonne, F-31062 Toulouse, France [2] Université de Toulouse; UMR5174; F-31062 Toulouse, France.
authors.forename: Etienne
authors.initials: E
authors.lastname: Danchin
authors.affiliation: INRA, 400 Route des Chappes, BP 167, 06903 Sophia Antipolis Cedex, France.
authors.forename: Eric
authors.initials: E
authors.lastname: Wajnberg
authors.affiliation: Konrad Lorenz Institute of Ethology, Department of Comparative Biology and Evolution, University of Veterinary Medicine, Vienna, Savoyenstrasse 1a, 1160 Vienna, Austria.
authors.forename: Richard H
authors.initials: RH
authors.lastname: Wagner
mesh_terms: D014644:Genetic Variation; D006801:Humans; D008957:Models, Genetic; D010641:Phenotype; D012919:Social Behavior