title: Power estimation for non-standardized multisite studies.
abstract: A concern for researchers planning multisite studies is that scanner and T1-weighted sequence-related biases on regional volumes could overshadow true effects, especially for studies with a heterogeneous set of scanners and sequences. Current approaches attempt to harmonize data by standardizing hardware, pulse sequences, and protocols, or by calibrating across sites using phantom-based corrections to ensure the same raw image intensities. We propose to avoid harmonization and phantom-based correction entirely. We hypothesized that the bias of estimated regional volumes is scaled between sites due to the contrast and gradient distortion differences between scanners and sequences. Given this assumption, we provide a new statistical framework and derive a power equation to define inclusion criteria for a set of sites based on the variability of their scaling factors. We estimated the scaling factors of 20 scanners with heterogeneous hardware and sequence parameters by scanning a single set of 12 subjects at sites across the United States and Europe. Regional volumes and their scaling factors were estimated for each site using Freesurfer's segmentation algorithm and ordinary least squares, respectively. The scaling factors were validated by comparing the theoretical and simulated power curves, performing a leave-one-out calibration of regional volumes, and evaluating the absolute agreement of all regional volumes between sites before and after calibration. Using our derived power equation, we were able to define the conditions under which harmonization is not necessary to achieve 80% power. This approach can inform choice of processing pipelines and outcome metrics for multisite studies based on scaling factor variability across sites, enabling collaboration between clinical and research institutions.
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA; UC Berkeley-UCSF Graduate Program in Bioengineering, San Francisco, CA, USA. Electronic address: anisha.keshavan@ucsf.edu.
authors.forename: Anisha
authors.initials: A
authors.lastname: Keshavan
authors.affiliation: NeuroCure Clinical Research Center and Clinical and Experimental Multiple Sclerosis Research Center, Department of Neurology, Charité University Medicine Berlin, Berlin, Germany; Experimental and Clinical Research Center, Max Delbrueck Center for Molecular Medicine and Charité University Medicine Berlin, Berlin, Germany. Electronic address: Friedemann.Paul@charite.de.
authors.forename: Friedemann
authors.initials: F
authors.lastname: Paul
authors.affiliation: Department of Radiology and Nuclear Medicine, Oslo University Hospital, Oslo, Norway. Electronic address: mona.beyer@lyse.net.
authors.forename: Mona K
authors.initials: MK
authors.lastname: Beyer
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA. Electronic address: Alyssa.Zhu@ucsf.edu.
authors.forename: Alyssa H
authors.initials: AH
authors.lastname: Zhu
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA. Electronic address: Nico.Papinutto@ucsf.edu.
authors.forename: Nico
authors.initials: N
authors.lastname: Papinutto
authors.affiliation: Department of Biostatistics and Epidemiology, Center for Clinical Epidemiology and Biostatistics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, USA. Electronic address: rshi@mail.med.upenn.edu.
authors.forename: Russell T
authors.initials: RT
authors.lastname: Shinohara
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA. Electronic address: William.Stern@ucsf.edu.
authors.forename: William
authors.initials: W
authors.lastname: Stern
authors.affiliation: Department of Neurology, Basel University Hospital, University of Basel, Basel, Switzerland. Electronic address: michael.amann@usb.ch.
authors.forename: Michael
authors.initials: M
authors.lastname: Amann
authors.affiliation: Brigham and Women's Hospital, MA, United States. Electronic address: rbakshi@post.harvard.edu.
authors.forename: Rohit
authors.initials: R
authors.lastname: Bakshi
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA; Department of Neurology, Basel University Hospital, University of Basel, Basel, Switzerland; Clinical Immunology, University Hospital Basel,University of Basel, Basel, Switzerland. Electronic address: antje.Bischof@ucsf.edu.
authors.forename: Antje
authors.initials: A
authors.lastname: Bischof
authors.affiliation: Department of Translational Medicine, Department of Radiology, UPO University, Via Solaroli 17, 28100 Novara, Italy. Electronic address: alessandro.carriero@med.unipmn.it.
authors.forename: Alessandro
authors.initials: A
authors.lastname: Carriero
authors.affiliation: Hospital Universitari Vall d'Hebron, Barcelona, Spain. Electronic address: manuel.comabella@vhir.org.
authors.forename: Manuel
authors.initials: M
authors.lastname: Comabella
authors.affiliation: Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA. Electronic address: Jason.Crane@ucsf.edu.
authors.forename: Jason C
authors.initials: JC
authors.lastname: Crane
authors.affiliation: Department of Health Sciences, UPO University, Novara, Italy. Electronic address: sandra.dalfonso@med.uniupo.it.
authors.forename: Sandra
authors.initials: S
authors.lastname: D'Alfonso
authors.affiliation: Department of Radiology, University Hospitals Leuven, Leuven, Belgium. Electronic address: Philippe.Demaerel@uzleuven.be.
authors.forename: Philippe
authors.initials: P
authors.lastname: Demaerel
authors.affiliation: KU Leuven-University of Leuven, Department of Neurosciences, Leuven, Belgium. Electronic address: Benedicte.dubois@uzleuven.be.
authors.forename: Benedicte
authors.initials: B
authors.lastname: Dubois
authors.affiliation: Neuroimaging Research Unit, Institute of Experimental Neurology, Division of Neuroscience, San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. Electronic address: zonca.lucia@hsr.it.
authors.forename: Massimo
authors.initials: M
authors.lastname: Filippi
authors.affiliation: Department of Neurology, Focus Program Translational Neuroscience (FTN) and Immunotherapy (FZI), Rhine-Main Neuroscience Network (rmn2), University Medical Centre of the Johannes Gutenberg University Mainz, Germany. Electronic address: Vinzenz.Fleischer@unimedizin-mainz.de.
authors.forename: Vinzenz
authors.initials: V
authors.lastname: Fleischer
authors.affiliation: Hôpital Pitié-Salpêtrière, ICM, UPMC 06 UM 75, INSERM U 1127, CNRS UMR 7225, IHU-A-ICM, AP-HP: Pôle des maladies du système nerveux, 47 boulevard de l'Hôpital, 75013 Paris, France. Electronic address: bertrand.fontaine@upmc.fr.
authors.forename: Bertrand
authors.initials: B
authors.lastname: Fontaine
authors.affiliation: Department of Neurology, Basel University Hospital, University of Basel, Basel, Switzerland; Medical Image Analysis Center (MIAC AG), Basel, Switzerland. Electronic address: laura.gaetanosf@gmail.com.
authors.forename: Laura
authors.initials: L
authors.lastname: Gaetano
authors.affiliation: KU Leuven-University of Leuven, Department of Neurosciences, Leuven, Belgium. Electronic address: An.Goris@med.kuleuven.be.
authors.forename: An
authors.initials: A
authors.lastname: Goris
authors.affiliation: Department of Neurology, Focus Program Translational Neuroscience (FTN) and Immunotherapy (FZI), Rhine-Main Neuroscience Network (rmn2), University Medical Centre of the Johannes Gutenberg University Mainz, Germany. Electronic address: Christiane.Graetz@unimedizin-mainz.de.
authors.forename: Christiane
authors.initials: C
authors.lastname: Graetz
authors.affiliation: Department of Neurology, Focus Program Translational Neuroscience (FTN) and Immunotherapy (FZI), Rhine-Main Neuroscience Network (rmn2), University Medical Centre of the Johannes Gutenberg University Mainz, Germany. Electronic address: adriane.groeger@unimedizin-mainz.de.
authors.forename: Adriane
authors.initials: A
authors.lastname: Gröger
authors.affiliation: Department of Neurology, Focus Program Translational Neuroscience (FTN) and Immunotherapy (FZI), Rhine-Main Neuroscience Network (rmn2), University Medical Centre of the Johannes Gutenberg University Mainz, Germany. Electronic address: Sergiu.Groppa@unimedizin-mainz.de.
authors.forename: Sergiu
authors.initials: S
authors.lastname: Groppa
authors.affiliation: Departments of Neurology and Immunobiology, Yale School of Medicine, CT, USA. Electronic address: david.hafler@yale.edu.
authors.forename: David A
authors.initials: DA
authors.lastname: Hafler
authors.affiliation: Department of Neurology, Oslo University Hospital and University of Oslo, Oslo, Norway. Electronic address: h.f.harbo@medisin.uio.no.
authors.forename: Hanne F
authors.initials: HF
authors.lastname: Harbo
authors.affiliation: Dept. Neurology of the Klinikum rechts der Isar, Technische Universität München, Munich, Germany; Munich Cluster of Systems Neurology (SyNery), Germany. Electronic address: hemmer@tum.de.
authors.forename: Bernhard
authors.initials: B
authors.lastname: Hemmer
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA; UC Berkeley-UCSF Graduate Program in Bioengineering, San Francisco, CA, USA. Electronic address: Kesshi.Jordan@ucsf.edu.
authors.forename: Kesshi
authors.initials: K
authors.lastname: Jordan
authors.affiliation: Department of Neurology, Basel University Hospital, University of Basel, Basel, Switzerland. Electronic address: Ludwig.Kappos@usb.ch.
authors.forename: Ludwig
authors.initials: L
authors.lastname: Kappos
authors.affiliation: Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA. Electronic address: Gina.Kirkish@ucsf.edu.
authors.forename: Gina
authors.initials: G
authors.lastname: Kirkish
authors.affiliation: Center for Neuroimmunology, Hospital Clinic Barcelona, IDIBAPS, Barcelona, Spain. Electronic address: SLLUFRIU@clinic.ub.es.
authors.forename: Sara
authors.initials: S
authors.lastname: Llufriu
authors.affiliation: Department of Neurology, Basel University Hospital, University of Basel, Basel, Switzerland. Electronic address: Stefano.Magon@usb.ch.
authors.forename: Stefano
authors.initials: S
authors.lastname: Magon
authors.affiliation: Neuroimaging Research Unit, Institute of Experimental Neurology, Division of Neuroscience, San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. Electronic address: martinelli.filippo@hsr.it.
authors.forename: Filippo
authors.initials: F
authors.lastname: Martinelli-Boneschi
authors.affiliation: John P. Hussman Institute for Human Genomics and the Dr. John T. Macdonald Foundation Department of Human Genetics, University of Miami, Miami, USA. Electronic address: jmccauley@med.miami.edu.
authors.forename: Jacob L
authors.initials: JL
authors.lastname: McCauley
authors.affiliation: Hospital Universitari Vall d'Hebron, Barcelona, Spain. Electronic address: xavier.montalban@cem-cat.org.
authors.forename: Xavier
authors.initials: X
authors.lastname: Montalban
authors.affiliation: Dept. Neurology of the Klinikum rechts der Isar, Technische Universität München, Munich, Germany; TUM-Neuroimaging Center, Technische Universität München, Munich, Germany. Electronic address: muehlau@lrz.tu-muenchen.de.
authors.forename: Mark
authors.initials: M
authors.lastname: Mühlau
authors.affiliation: Departments of Neurology and Immunobiology, Yale School of Medicine, CT, USA. Electronic address: daniel.pelletier@yale.edu.
authors.forename: Daniel
authors.initials: D
authors.lastname: Pelletier
authors.affiliation: Department of Radiology, University of Miami Miller School of Medicine, Miami, FL, USA. Electronic address: PPattany@med.miami.edu.
authors.forename: Pradip M
authors.initials: PM
authors.lastname: Pattany
authors.affiliation: John P. Hussman Institute for Human Genomics and the Dr. John T. Macdonald Foundation Department of Human Genetics, University of Miami, Miami, USA. Electronic address: MPericak@med.miami.edu.
authors.forename: Margaret
authors.initials: M
authors.lastname: Pericak-Vance
authors.affiliation: Hôpital Pitié-Salpêtrière, ICM, UPMC 06 UM 75, INSERM U 1127, CNRS UMR 7225, IHU-A-ICM, AP-HP: Pôle des maladies du système nerveux, 47 boulevard de l'Hôpital, 75013 Paris, France. Electronic address: isabelle.rebeix@upmc.fr.
authors.forename: Isabelle
authors.initials: I
authors.lastname: Cournu-Rebeix
authors.affiliation: Neuroimaging Research Unit, Institute of Experimental Neurology, Division of Neuroscience, San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. Electronic address: rocca.mara@hsr.it.
authors.forename: Maria A
authors.initials: MA
authors.lastname: Rocca
authors.affiliation: Hospital Universitari Vall d'Hebron, Barcelona, Spain. Electronic address: alex.rovira@idi.gencat.cat.
authors.forename: Alex
authors.initials: A
authors.lastname: Rovira
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA; Department of Neurology, Basel University Hospital, University of Basel, Basel, Switzerland; Clinical Immunology, University Hospital Basel,University of Basel, Basel, Switzerland. Electronic address: regina.schlaeger@ucsf.edu.
authors.forename: Regina
authors.initials: R
authors.lastname: Schlaeger
authors.affiliation: Center for Neuroimmunology, Hospital Clinic Barcelona, IDIBAPS, Barcelona, Spain. Electronic address: ASAIZ@clinic.ub.es.
authors.forename: Albert
authors.initials: A
authors.lastname: Saiz
authors.affiliation: Department of Neurology, Basel University Hospital, University of Basel, Basel, Switzerland; DKD Helios Klinik Wiesbaden, Wiesbaden, Germany. Electronic address: Till.sprenger@usb.ch.
authors.forename: Till
authors.initials: T
authors.lastname: Sprenger
authors.affiliation: Section of Neuroradiology, Department of Radiology, Maggiore Hospital, Corso Mazzini 18, 28100, Novara, Italy. Electronic address: a.stecco@libero.it.
authors.forename: Alessandro
authors.initials: A
authors.lastname: Stecco
authors.affiliation: MS Center Amsterdam, VU University Medical Center Amsterdam, The Netherlands. Electronic address: bmj.uitdehaag@vumc.nl.
authors.forename: Bernard M J
authors.initials: BMJ
authors.lastname: Uitdehaag
authors.affiliation: Center for Neuroimmunology, Hospital Clinic Barcelona, IDIBAPS, Barcelona, Spain. Electronic address: Pablo.VillosladaDiaz@ucsf.edu.
authors.forename: Pablo
authors.initials: P
authors.lastname: Villoslada
authors.affiliation: MS Center Amsterdam, VU University Medical Center Amsterdam, The Netherlands. Electronic address: m.wattjes@vumc.nl.
authors.forename: Mike P
authors.initials: MP
authors.lastname: Wattjes
authors.affiliation: Brigham and Women's Hospital, MA, United States. Electronic address: hweiner@rics.bwh.harvard.edu.
authors.forename: Howard
authors.initials: H
authors.lastname: Weiner
authors.affiliation: NeuroCure Clinical Research Center and Clinical and Experimental Multiple Sclerosis Research Center, Department of Neurology, Charité University Medicine Berlin, Berlin, Germany; Medical Image Analysis Center, Basel, Switzerland. Electronic address: jw@miac.ch.
authors.forename: Jens
authors.initials: J
authors.lastname: Wuerfel
authors.affiliation: Dept. Neuroradiology, Klinikum rechts der Isar, Technische Universität München, Munich, Germany. Electronic address: claus.zimmer@tum.de.
authors.forename: Claus
authors.initials: C
authors.lastname: Zimmer
authors.affiliation: Department of Neurology, Focus Program Translational Neuroscience (FTN) and Immunotherapy (FZI), Rhine-Main Neuroscience Network (rmn2), University Medical Centre of the Johannes Gutenberg University Mainz, Germany. Electronic address: Frauke.zipp@unimedizin-mainz.de.
authors.forename: Frauke
authors.initials: F
authors.lastname: Zipp
authors.affiliation: International Multiple Sclerosis Genetics Consortium, USA, EU, AU.
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA. Electronic address: Stephen.Hauser@ucsf.edu.
authors.forename: Stephen L
authors.initials: SL
authors.lastname: Hauser
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA. Electronic address: Jorge.Oksenberg@ucsf.edu.
authors.forename: Jorge R
authors.initials: JR
authors.lastname: Oksenberg
authors.affiliation: Department of Neurology, University of California, San Francisco, CA, USA; UC Berkeley-UCSF Graduate Program in Bioengineering, San Francisco, CA, USA; Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA. Electronic address: Roland.Henry@ucsf.edu.
authors.forename: Roland G
authors.initials: RG
authors.lastname: Henry
mesh_terms: D000465:Algorithms; D016477:Artifacts; D001921:Brain / Q000033:anatomy & histology*; D003198:Computer Simulation; D004867:Equipment Design; D019544:Equipment Failure Analysis; D005060:Europe; D006801:Humans; D007089:Image Enhancement / Q000295:instrumentation / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000295:instrumentation* / Q000379:methods*; D008279:Magnetic Resonance Imaging / Q000295:instrumentation* / Q000379:methods*; D015233:Models, Statistical; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D014481:United States