title: ERP Reliability Analysis (ERA) Toolbox: An open-source toolbox for analyzing the reliability of event-related brain potentials.
abstract: Generalizability theory (G theory) provides a flexible, multifaceted approach to estimating score reliability. G theory's approach to estimating score reliability has important advantages over classical test theory that are relevant for research using event-related brain potentials (ERPs). For example, G theory does not require parallel forms (i.e., equal means, variances, and covariances), can handle unbalanced designs, and provides a single reliability estimate for designs with multiple sources of error. This monograph provides a detailed description of the conceptual framework of G theory using examples relevant to ERP researchers, presents the algorithms needed to estimate ERP score reliability, and provides a detailed walkthrough of newly-developed software, the ERP Reliability Analysis (ERA) Toolbox, that calculates score reliability using G theory. The ERA Toolbox is open-source, Matlab software that uses G theory to estimate the contribution of the number of trials retained for averaging, group, and/or event types on ERP score reliability. The toolbox facilitates the rigorous evaluation of psychometric properties of ERP scores recommended elsewhere in this special issue.
authors: Department of Psychology, University of California Los Angeles, Los Angeles, CA, United States. Electronic address: peter.clayson@gmail.com.
authors: Peter E
authors: PE
authors: Clayson
authors: Department of Psychology, University of California Los Angeles, Los Angeles, CA, United States; Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, United States.
authors: Gregory A
authors: GA
authors: Miller
mesh_terms: D003627:Data Interpretation, Statistical; D001330:Electronic Data Processing / Q000295:instrumentation / Q000379:methods / Q000592:standards; D005071:Evoked Potentials / Q000502:physiology*; D006801:Humans; D011603:Psychophysiology / Q000295:instrumentation / Q000379:methods / Q000592:standards; D015203:Reproducibility of Results
keywords: Dependability; ERP Reliability Analysis Toolbox; Event-related potentials; Generalizability theory; Psychometrics