title: Measuring executive function in early childhood: a focus on maximal reliability and the derivation of short forms.
abstract: This study assesses the maximal reliability of a newly developed battery of executive function (EF) tasks for use in early childhood. It also demonstrates how changes in maximal reliability can inform the selection of different short forms of the battery, depending on child age. Participants included children from the Family Life Project (Vernon-Feagans, Cox, & Family Life Project Investigators, in press)--a prospective longitudinal study (N = 1,292) of families that were recruited at the time of the birth of a new child--who were assessed at ages 3, 4, and 5 years. Results indicate that the EF battery had reasonably good maximal reliability (ρ = .73, 95% confidence interval [CI] = .69, .76) in a mixed-age sample of children randomly selected from assessments at ages 3, 4, and 5. In contrast, maximal reliability of the battery ranged from poor to modest for within-age samples (ρs = .47 [95% CI = .37, .52], .62 [.57, .66], and .61 [.55, .66] at ages 3, 4, and 5, respectively). Although the derivation of a 3-task short form of the battery always resulted in statistically significant decrements in maximal reliability, in some cases the relative decrement was quite modest and may be tolerable given the time savings and potential reduction in participant burden. The benefits of using maximal reliability to both evaluate task batteries and derive short forms are discussed, as well as how a focus on maximal reliability informs ongoing questions about the measurement and conceptualization of EF in early childhood.
authors: FPG Child Development Institute, University of North Carolina at Chapel Hill, Carrboro, NC 27510, USA. willoughby@unc.edu
authors: Michael T
authors: MT
authors: Willoughby
authors: Jolynn
authors: J
authors: Pek
authors: Clancy B
authors: CB
authors: Blair
mesh_terms: D002657:Child Development / Q000502:physiology*; D002675:Child, Preschool; D003430:Cross-Sectional Studies; D056344:Executive Function / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D009483:Neuropsychological Tests / Q000592:standards*; D011446:Prospective Studies; D011594:Psychometrics / Q000295:instrumentation*; D015203:Reproducibility of Results; D014481:United States
references: Psychol Assess. 2012 Mar;24(1):226-39
references: 21966934
references: Br J Math Stat Psychol. 2005 May;58(Pt 1):65-82
references: 15969840
references: Neuropsychology. 2006 Sep;20(5):607-13
references: 16938023
references: Psychol Assess. 2010 Jun;22(2):306-17
references: 20528058
references: J Exp Child Psychol. 2011 Mar;108(3):436-52
references: 20884004
references: Dev Psychol. 2008 Mar;44(2):575-87
references: 18331145
references: J Exp Child Psychol. 2011 Mar;108(3):414-35
references: 20553690
references: Psychol Methods. 2006 Dec;11(4):323-43
references: 17154750
references: Memory. 2007 Jul;15(5):526-35
references: 17613795
references: J Exp Psychol Gen. 2003 Mar;132(1):47-70
references: 12656297
references: Curr Dir Psychol Sci. 2012 Feb;21(1):8-14
references: 22773897
references: Appl Neuropsychol. 2005;12(4):190-201
references: 16422660
references: Br J Math Stat Psychol. 2004 May;57(Pt 1):21-7
references: 15171799
references: Dev Neuropsychol. 2010;35(6):679-97
references: 21038160
references: Cogn Psychol. 2000 Aug;41(1):49-100
references: 10945922
references: Trends Cogn Sci. 1998 Nov 1;2(11):436-47
references: 21227275
references: Dev Neuropsychol. 2001;20(3):573-91
references: 12002094
references: Prog Brain Res. 2000;126:183-92
references: 11105647
references: J Child Psychol Psychiatry. 2012 Feb;53(2):111-9
references: 22022931
references: Monogr Soc Res Child Dev. 2013 Oct;78(5):1-150, vii
references: 24147448
references: Psychol Bull. 2008 Jan;134(1):31-60
references: 18193994
references: Neuropsychologia. 1982;20(3):249-62
references: 7121793
references: Child Neuropsychol. 2011;17(6):564-79
references: 21714751
references: Multivariate Behav Res. 2006 Jun 1;41(2):105-26
references: 26782906
references: Am Psychol. 2012 Feb-Mar;67(2):87-100
references: 21787037
references: Psychol Assess. 2012 Jun;24(2):418-31
references: 22023561
references: Cognition. 1994 Nov;53(2):129-53
references: 7805351
references: Dev Neuropsychol. 2010;35(1):20-36
references: 20390590