title: A systematic review of the reporting of sample size calculations and corresponding data components in observational functional magnetic resonance imaging studies.
abstract: Anecdotal evidence suggests that functional magnetic resonance imaging (fMRI) studies rarely consider statistical power when setting a sample size. This raises concerns since undersized studies may fail to detect effects of interest and encourage data dredging. Although sample size methodology in this field exists, implementation requires specifications of estimated effect size and variance components. We therefore systematically evaluated how often estimates of effect size and variance components were reported in observational fMRI studies involving clinical human participants published in six leading journals between January 2010 and December 2011. A random sample of 100 eligible articles was included in data extraction and analyses. Two independent reviewers assessed the reporting of sample size calculations and the data components required to perform the calculations in the fMRI literature. One article (1%) reported sample size calculations. The reporting of parameter estimates for effect size (8%), between-subject variance (4%), within-subject variance (1%) and temporal autocorrelation matrix (0%) was uncommon. Three articles (3%) reported Cohen's d or F effect sizes. The majority (83%) reported peak or average t, z or F statistics. The inter-rater agreement was very good, with a prevalence-adjusted bias-adjusted kappa (PABAK) value greater than 0.88. We concluded that sample size calculations were seldom reported in fMRI studies. Moreover, omission of parameter estimates for effect size, between- and within-subject variances, and temporal autocorrelation matrix could limit investigators' ability to perform power analyses for new studies. We suggest routine reporting of these quantities, and recommend strategies for reducing bias in their reported values.
authors: Department of Epidemiology and Biostatistics, Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada; Biostatistics Unit, St Joseph's Healthcare Hamilton, Hamilton, ON, Canada. Electronic address: guoq@mcmaster.ca.
authors: Qing
authors: Q
authors: Guo
authors: Department of Epidemiology and Biostatistics, Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada; Biostatistics Unit, St Joseph's Healthcare Hamilton, Hamilton, ON, Canada; Centre for Evaluation of Medicine, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada.
authors: Lehana
authors: L
authors: Thabane
authors: Department of Psychiatry and Behavioural Neurosciences, McMaster University, ON, Canada.
authors: Geoffrey
authors: G
authors: Hall
authors: Department of Psychiatry and Behavioural Neurosciences, McMaster University, ON, Canada; Mood Disorders Program, St. Joseph's Healthcare Hamilton, ON, Canada; Kunin-Lunenfeld Applied Research Unit, Baycrest, Toronto, ON, Canada.
authors: Margaret
authors: M
authors: McKinnon
authors: Department of Epidemiology and Biostatistics, Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada; Centre for Evaluation of Medicine, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada; PATH Research Institute, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada.
authors: Ron
authors: R
authors: Goeree
authors: Department of Epidemiology and Biostatistics, Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada; Biostatistics Unit, St Joseph's Healthcare Hamilton, Hamilton, ON, Canada; Centre for Evaluation of Medicine, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada; The Hospital for Sick Children, Toronto, ON, Canada.
authors: Eleanor
authors: E
authors: Pullenayegum
mesh_terms: D016477:Artifacts; D003627:Data Interpretation, Statistical; D016208:Databases, Factual / Q000706:statistics & numerical data*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods; D008279:Magnetic Resonance Imaging / Q000379:methods / Q000706:statistics & numerical data*; D064887:Observational Studies as Topic / Q000706:statistics & numerical data*; D018401:Sample Size
keywords: Effect size; Functional magnetic resonance imaging (fMRI); Sample size; Statistical power; Variance components