The problem of pseudoreplication in neuroscientific studies: is it affecting your analysis?
BACKGROUND
Pseudoreplication occurs when observations are not statistically independent, but treated as if they are. This can occur when there are multiple observations on the same subjects, when samples are nested or hierarchically organised, or when measurements are correlated in time or space. Analysis of such data without taking these dependencies into account can lead to meaningless results, and examples can easily be found in the neuroscience literature.


RESULTS
A single issue of Nature Neuroscience provided a number of examples and is used as a case study to highlight how pseudoreplication arises in neuroscientific studies, why the analyses in these papers are incorrect, and appropriate analytical methods are provided. 12% of papers had pseudoreplication and a further 36% were suspected of having pseudoreplication, but it was not possible to determine for certain because insufficient information was provided.


CONCLUSIONS
Pseudoreplication can undermine the conclusions of a statistical analysis, and it would be easier to detect if the sample size, degrees of freedom, the test statistic, and precise p-values are reported. This information should be a requirement for all publications.
Lazic
Stanley E
SE
Department of Applied Mathematics and Theoretical Physics, Cambridge Computational Biology Institute, University of Cambridge, Cambridge CB3 0WA, UK. stan.lazic@cantab.net
D000704:Analysis of Variance; D000818:Animals; D035843:Biomedical Research / Q000379:methods*; D003198:Computer Simulation; D016014:Linear Models; D015233:Models, Statistical; D009488:Neurosciences / Q000379:methods*; D010506:Periodicals as Topic; D013997:Time Factors