title: An open science resource for establishing reliability and reproducibility in functional connectomics.
abstract: Efforts to identify meaningful functional imaging-based biomarkers are limited by the ability to reliably characterize inter-individual differences in human brain function. Although a growing number of connectomics-based measures are reported to have moderate to high test-retest reliability, the variability in data acquisition, experimental designs, and analytic methods precludes the ability to generalize results. The Consortium for Reliability and Reproducibility (CoRR) is working to address this challenge and establish test-retest reliability as a minimum standard for methods development in functional connectomics. Specifically, CoRR has aggregated 1,629 typical individuals' resting state fMRI (rfMRI) data (5,093 rfMRI scans) from 18 international sites, and is openly sharing them via the International Data-sharing Neuroimaging Initiative (INDI). To allow researchers to generate various estimates of reliability and reproducibility, a variety of data acquisition procedures and experimental designs are included. Similarly, to enable users to assess the impact of commonly encountered artifacts (for example, motion) on characterizations of inter-individual variation, datasets of varying quality are included.
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Xi-Nian
authors.initials: XN
authors.lastname: Zuo
authors.affiliation: Division of Neuroradiology, University of Utah , Salt Lake City, Utah 84132, USA.
authors.forename: Jeffrey S
authors.initials: JS
authors.lastname: Anderson
authors.affiliation: Unité de neuroimagerie fonctionnelle, Centre de recherche de l'institut universitaire de gériatrie de Montréal, Université de Montréal , Montreal, Quebec, Canada H3W 1W5.
authors.forename: Pierre
authors.initials: P
authors.lastname: Bellec
authors.affiliation: Department of Psychiatry, University of Wisconsin-Madison , Madison, Wisconsin 53719, USA.
authors.forename: Rasmus M
authors.initials: RM
authors.lastname: Birn
authors.affiliation: Department of Biomedical Engineering, New Jersey Institute of Technology , Newark, New Jersey 07102, USA.
authors.forename: Bharat B
authors.initials: BB
authors.lastname: Biswal
authors.affiliation: Institute of Clinical Radiology, Ludwig-Maximilians-University , 80336 Munich, Germany.
authors.forename: Janusch
authors.initials: J
authors.lastname: Blautzik
authors.affiliation: Centre for Studies on Prevention of Alzheimer's Disease, Department of Psychiatry, Douglas Institute, McGill University Faculty of Medicine , Montreal, Quebec, Canada H4H 1R3.
authors.forename: John C S
authors.initials: JC
authors.lastname: Breitner
authors.affiliation: Department of Psychology, Harvard University , Cambridge, Massachussetts 02138, USA.
authors.forename: Randy L
authors.initials: RL
authors.lastname: Buckner
authors.affiliation: Mind Research Network , Albuquerque, New Mexico 87106, USA.
authors.forename: Vince D
authors.initials: VD
authors.lastname: Calhoun
authors.affiliation: Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA ; Phyllis Green and Randolph Cōwen Institute for Pediatric Neuroscience, the Child Study Center at NYU Langone Medical Center , New York, New York 10016, USA.
authors.forename: F Xavier
authors.initials: FX
authors.lastname: Castellanos
authors.affiliation: Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Antao
authors.initials: A
authors.lastname: Chen
authors.affiliation: Center for Cognition and Brain Disorders, Hangzhou Normal University, Gongshu , Hangzhou, Zhejiang 311121, China.
authors.forename: Bing
authors.initials: B
authors.lastname: Chen
authors.affiliation: Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Jiangtao
authors.initials: J
authors.lastname: Chen
authors.affiliation: Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Xu
authors.initials: X
authors.lastname: Chen
authors.affiliation: Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA.
authors.forename: Stanley J
authors.initials: SJ
authors.lastname: Colcombe
authors.affiliation: Mind Research Network , Albuquerque, New Mexico 87106, USA.
authors.forename: William
authors.initials: W
authors.lastname: Courtney
authors.affiliation: Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA ; Center for the Developing Brain, Child Mind Institute , New York, New York 10022, USA.
authors.forename: R Cameron
authors.initials: RC
authors.lastname: Craddock
authors.affiliation: Phyllis Green and Randolph Cōwen Institute for Pediatric Neuroscience, the Child Study Center at NYU Langone Medical Center , New York, New York 10016, USA.
authors.forename: Adriana
authors.initials: A
authors.lastname: Di Martino
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Hao-Ming
authors.initials: HM
authors.lastname: Dong
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China.
authors.forename: Xiaolan
authors.initials: X
authors.lastname: Fu
authors.affiliation: Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Wuhou , Chengdu, Sichuan 610041, China.
authors.forename: Qiyong
authors.initials: Q
authors.lastname: Gong
authors.affiliation: Max Planck Research Group for Neuroanatomy & Connectivity, Max Planck Institute for Human Cognitive and Brain Sciences , 04103 Leipzig, Germany.
authors.forename: Krzysztof J
authors.initials: KJ
authors.lastname: Gorgolewski
authors.affiliation: Department of Neurology, Xuanwu Hospital, Capital Medical University , Xicheng, Beijing 100053, China.
authors.forename: Ying
authors.initials: Y
authors.lastname: Han
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Ye
authors.initials: Y
authors.lastname: He
authors.affiliation: State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University , Haidian, Beijing 100875, China.
authors.forename: Yong
authors.initials: Y
authors.lastname: He
authors.affiliation: Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA ; Center for the Developing Brain, Child Mind Institute , New York, New York 10022, USA.
authors.forename: Erica
authors.initials: E
authors.lastname: Ho
authors.affiliation: Department of Psychology, Yale University , New Haven, Connecticut 06511, USA.
authors.forename: Avram
authors.initials: A
authors.lastname: Holmes
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Xiao-Hui
authors.initials: XH
authors.lastname: Hou
authors.affiliation: Department of Psychological and Brain Sciences, Center for Cognitive Neuroscience, Dartmouth College , Hanover, New Hampshire 03755, USA.
authors.forename: Jeremy
authors.initials: J
authors.lastname: Huckins
authors.affiliation: Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences , Haidian, Beijing 100190, China.
authors.forename: Tianzi
authors.initials: T
authors.lastname: Jiang
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China.
authors.forename: Yi
authors.initials: Y
authors.lastname: Jiang
authors.affiliation: Department of Psychological and Brain Sciences, Center for Cognitive Neuroscience, Dartmouth College , Hanover, New Hampshire 03755, USA.
authors.forename: William
authors.initials: W
authors.lastname: Kelley
authors.affiliation: Phyllis Green and Randolph Cōwen Institute for Pediatric Neuroscience, the Child Study Center at NYU Langone Medical Center , New York, New York 10016, USA.
authors.forename: Clare
authors.initials: C
authors.lastname: Kelly
authors.affiliation: Mind Research Network , Albuquerque, New Mexico 87106, USA.
authors.forename: Margaret
authors.initials: M
authors.lastname: King
authors.affiliation: Virginia Tech Carilion Research Institute , Roanoke, Virginia 24016, USA.
authors.forename: Stephen M
authors.initials: SM
authors.lastname: LaConte
authors.affiliation: Department of Psychiatry, University of Wisconsin-Madison , Madison, Wisconsin 53719, USA.
authors.forename: Janet E
authors.initials: JE
authors.lastname: Lainhart
authors.affiliation: Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Xu
authors.initials: X
authors.lastname: Lei
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China.
authors.forename: Hui-Jie
authors.initials: HJ
authors.lastname: Li
authors.affiliation: Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Wuhou , Chengdu, Sichuan 610041, China.
authors.forename: Kaiming
authors.initials: K
authors.lastname: Li
authors.affiliation: Department of Radiology, Xuanwu Hospital, Capital Medical University , Xicheng, Beijing 100053, China.
authors.forename: Kuncheng
authors.initials: K
authors.lastname: Li
authors.affiliation: State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University , Haidian, Beijing 100875, China.
authors.forename: Qixiang
authors.initials: Q
authors.lastname: Lin
authors.affiliation: Center for Cognition and Brain Disorders, Hangzhou Normal University, Gongshu , Hangzhou, Zhejiang 311121, China.
authors.forename: Dongqiang
authors.initials: D
authors.lastname: Liu
authors.affiliation: State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University , Haidian, Beijing 100875, China.
authors.forename: Jia
authors.initials: J
authors.lastname: Liu
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China.
authors.forename: Xun
authors.initials: X
authors.lastname: Liu
authors.affiliation: Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Yijun
authors.initials: Y
authors.lastname: Liu
authors.affiliation: Department of Medical Imaging, Jinling Hospital, School of Medicine, Nanjing University, Xuanwu , Nanjing, Jiangsu 210002, China.
authors.forename: Guangming
authors.initials: G
authors.lastname: Lu
authors.affiliation: Department of Radiology, Xuanwu Hospital, Capital Medical University , Xicheng, Beijing 100053, China.
authors.forename: Jie
authors.initials: J
authors.lastname: Lu
authors.affiliation: Department of Psychiatry, School of Medicine, University of Pittsburgh , Pittsburgh, Pennsylvania 15213, USA.
authors.forename: Beatriz
authors.initials: B
authors.lastname: Luna
authors.affiliation: Beijing Key Laboratory of Learning and Cognition, Department of Psychology, Capital Normal University , Haidian, Beijing 100048, China.
authors.forename: Jing
authors.initials: J
authors.lastname: Luo
authors.affiliation: Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA ; Center for the Developing Brain, Child Mind Institute , New York, New York 10022, USA.
authors.forename: Daniel
authors.initials: D
authors.lastname: Lurie
authors.affiliation: Department of Neurosurgery, Huashan Hospital, Fudan University , Jingan, Shanghai 200040, China.
authors.forename: Ying
authors.initials: Y
authors.lastname: Mao
authors.affiliation: Max Planck Research Group for Neuroanatomy & Connectivity, Max Planck Institute for Human Cognitive and Brain Sciences , 04103 Leipzig, Germany.
authors.forename: Daniel S
authors.initials: DS
authors.lastname: Margulies
authors.affiliation: Mind Research Network , Albuquerque, New Mexico 87106, USA.
authors.forename: Andrew R
authors.initials: AR
authors.lastname: Mayer
authors.affiliation: Institute of Clinical Radiology, Ludwig-Maximilians-University , 80336 Munich, Germany.
authors.forename: Thomas
authors.initials: T
authors.lastname: Meindl
authors.affiliation: Department of Biomedical Engineering, University of Wisconsin-Madison , Madison, Wisconsin 53705, USA.
authors.forename: Mary E
authors.initials: ME
authors.lastname: Meyerand
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Weizhi
authors.initials: W
authors.lastname: Nan
authors.affiliation: Division of Neuroradiology, University of Utah , Salt Lake City, Utah 84132, USA.
authors.forename: Jared A
authors.initials: JA
authors.lastname: Nielsen
authors.affiliation: Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA ; Center for the Developing Brain, Child Mind Institute , New York, New York 10022, USA.
authors.forename: David
authors.initials: D
authors.lastname: O'Connor
authors.affiliation: Department of Psychiatry, School of Medicine, University of Pittsburgh , Pittsburgh, Pennsylvania 15213, USA.
authors.forename: David
authors.initials: D
authors.lastname: Paulsen
authors.affiliation: Department of Radiology, University of Wisconsin-Madison , Madison, Wisconsin 53705, USA.
authors.forename: Vivek
authors.initials: V
authors.lastname: Prabhakaran
authors.affiliation: Department of Radiology, Xuanwu Hospital, Capital Medical University , Xicheng, Beijing 100053, China.
authors.forename: Zhigang
authors.initials: Z
authors.lastname: Qi
authors.affiliation: Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Jiang
authors.initials: J
authors.lastname: Qiu
authors.affiliation: Department of Psychiatry, Huashan Hospital, Fudan University , Jingan, Shanghai 200021, China.
authors.forename: Chunhong
authors.initials: C
authors.lastname: Shao
authors.affiliation: Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA ; Center for the Developing Brain, Child Mind Institute , New York, New York 10022, USA.
authors.forename: Zarrar
authors.initials: Z
authors.lastname: Shehzad
authors.affiliation: Department of Radiology, Huashan Hospital, Fudan University , Jingan, Shanghai 200040, China.
authors.forename: Weijun
authors.initials: W
authors.lastname: Tang
authors.affiliation: Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences , Leipzig 04103, Germany.
authors.forename: Arno
authors.initials: A
authors.lastname: Villringer
authors.affiliation: Department of Psychiatry, Renmin Hospital of Wuhan University , Wuhan, Hubei 430060, China.
authors.forename: Huiling
authors.initials: H
authors.lastname: Wang
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Kai
authors.initials: K
authors.lastname: Wang
authors.affiliation: Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Dongtao
authors.initials: D
authors.lastname: Wei
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China.
authors.forename: Gao-Xia
authors.initials: GX
authors.lastname: Wei
authors.affiliation: Center for Cognition and Brain Disorders, Hangzhou Normal University, Gongshu , Hangzhou, Zhejiang 311121, China.
authors.forename: Xu-Chu
authors.initials: XC
authors.lastname: Weng
authors.affiliation: Department of Neurosurgery, Huashan Hospital, Fudan University , Jingan, Shanghai 200040, China.
authors.forename: Xuehai
authors.initials: X
authors.lastname: Wu
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA ; Center for the Developing Brain, Child Mind Institute , New York, New York 10022, USA.
authors.forename: Ting
authors.initials: T
authors.lastname: Xu
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Ning
authors.initials: N
authors.lastname: Yang
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China.
authors.forename: Zhi
authors.initials: Z
authors.lastname: Yang
authors.affiliation: Center for Cognition and Brain Disorders, Hangzhou Normal University, Gongshu , Hangzhou, Zhejiang 311121, China.
authors.forename: Yu-Feng
authors.initials: YF
authors.lastname: Zang
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Lei
authors.initials: L
authors.lastname: Zhang
authors.affiliation: Faculty of Psychology, Southwest University , Beibei, Chongqing 400715, China.
authors.forename: Qinglin
authors.initials: Q
authors.lastname: Zhang
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Zhe
authors.initials: Z
authors.lastname: Zhang
authors.affiliation: Department of Medical Imaging, Jinling Hospital, School of Medicine, Nanjing University, Xuanwu , Nanjing, Jiangsu 210002, China.
authors.forename: Zhiqiang
authors.initials: Z
authors.lastname: Zhang
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China.
authors.forename: Ke
authors.initials: K
authors.lastname: Zhao
authors.affiliation: State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University , Haidian, Beijing 100875, China.
authors.forename: Zonglei
authors.initials: Z
authors.lastname: Zhen
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China.
authors.forename: Yuan
authors.initials: Y
authors.lastname: Zhou
authors.affiliation: Key Laboratory of Behavioral Science and Magnetic Resonance Imaging Research Center, Institute of Psychology, Chinese Academy of Sciences , Chaoyang, Beijing 100101, China ; University of Chinese Academy of Sciences , Shijingshan, Beijing 100049, China.
authors.forename: Xing-Ting
authors.initials: XT
authors.lastname: Zhu
authors.affiliation: Nathan S. Kline Institute for Psychiatric Research , Orangeburg, New York 10962, USA ; Center for the Developing Brain, Child Mind Institute , New York, New York 10022, USA.
authors.forename: Michael P
authors.initials: MP
authors.lastname: Milham
mesh_terms: D001921:Brain / Q000502:physiology*; D063132:Connectome / Q000379:methods; D066264:Datasets as Topic; D006801:Humans; D008279:Magnetic Resonance Imaging; D015203:Reproducibility of Results