title: Tutorial on use of intraclass correlation coefficients for assessing intertest reliability and its application in functional near-infrared spectroscopy-based brain imaging.
abstract: Test-retest reliability of neuroimaging measurements is an important concern in the investigation of cognitive functions in the human brain. To date, intraclass correlation coefficients (ICCs), originally used in interrater reliability studies in behavioral sciences, have become commonly used metrics in reliability studies on neuroimaging and functional near-infrared spectroscopy (fNIRS). However, as there are six popular forms of ICC, the adequateness of the comprehensive understanding of ICCs will affect how one may appropriately select, use, and interpret ICCs toward a reliability study. We first offer a brief review and tutorial on the statistical rationale of ICCs, including their underlying analysis of variance models and technical definitions, in the context of assessment on intertest reliability. Second, we provide general guidelines on the selection and interpretation of ICCs. Third, we illustrate the proposed approach by using an actual research study to assess interest reliability of fNIRS-based, volumetric diffuse optical tomography of brain activities stimulated by a risk decision-making protocol. Last, special issues that may arise in reliability assessment using ICCs are discussed and solutions are suggested.
authors.affiliation: Joint Graduate Program between University of Texas at Arlington and University of Texas Southwestern Medical Center, University of Texas at Arlington, Department of Bioengineering, Texas 76019, United States.
authors.forename: Lin
authors.initials: L
authors.lastname: Li
authors.affiliation: University of Texas at Arlington, Department of Industrial and Manufacturing Systems Engineering, Texas 76019, United States.
authors.forename: Li
authors.initials: L
authors.lastname: Zeng
authors.affiliation: Joint Graduate Program between University of Texas at Arlington and University of Texas Southwestern Medical Center, University of Texas at Arlington, Department of Bioengineering, Texas 76019, United StatescNational Synchrotron Radiation Research Center.
authors.forename: Zi-Jing
authors.initials: ZJ
authors.lastname: Lin
authors.affiliation: Cook Children's Medical Center, Fort Worth, Texas 76104, United States.
authors.forename: Mary
authors.initials: M
authors.lastname: Cazzell
authors.affiliation: Joint Graduate Program between University of Texas at Arlington and University of Texas Southwestern Medical Center, University of Texas at Arlington, Department of Bioengineering, Texas 76019, United States.
authors.forename: Hanli
authors.initials: H
authors.lastname: Liu
mesh_terms: D000465:Algorithms; D000818:Animals; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping / Q000379:methods*; D004867:Equipment Design; D019544:Equipment Failure Analysis; D006801:Humans; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D010092:Oximetry / Q000379:methods*; D010101:Oxygen Consumption / Q000502:physiology; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D019265:Spectroscopy, Near-Infrared / Q000379:methods*