Why missing data matter in the longitudinal study of adolescent development: using the 4-H Study to understand the uses of different missing data methods.
The study of adolescent development rests on methodologically appropriate collection and interpretation of longitudinal data. While all longitudinal studies of adolescent development involve missing data, the methods to treat missingness that have been recommended most often focus on missing data from cross-sectional studies. The problems of missing data in longitudinal studies are not described well, there are not many statistical software programs developed for researchers to use, and there are no longitudinal empirical examples involving adolescent development that show the extent to which different missing data procedures can yield different results. Data from the first three waves of the 4-H Study of Positive Youth Development were used to provide such an illustration. The sample contains 2,265 participants (56.7% females) who were in Grade 5 at Wave 1, in Grade 6 at Wave 2, and in Grade 7 at Wave 3, and varied in race, ethnicity, socioeconomic status, family structure, rural-urban location, and geographic region. The results showed that three missing data techniques, i.e., listwise deletion, direct maximum likelihood (DirML), and multiple imputation (MI), did not yield comparable results for research questions assessing different aspects of development (i.e., change over time or prediction effects). The results indicated also that listwise deletion should not be used. Instead, both DirML and MI methods should be used to determine if and how results change when these procedures are employed.
Jelicić
Helena
H
National Children's Bureau, 8 Wakley Street, London EC1V 7QE, UK. helena.jelicic@alumni.tufts.edu
Phelps
Erin
E
Lerner
Richard M
RM
D000293:Adolescent; D041923:Adolescent Development; D002648:Child; D003071:Cognition; D003627:Data Interpretation, Statistical; D005260:Female; D006801:Humans; D008137:Longitudinal Studies; D008297:Male; D002666:Psychology, Child / Q000706:statistics & numerical data*; D011795:Surveys and Questionnaires
Psychol Methods. 2002 Jun;7(2):147-77
12090408
Psychol Methods. 2001 Dec;6(4):317-29
11778675
Child Adolesc Psychiatr Clin N Am. 2007 Apr;16(2):473-96, xi-xii
17349519
Biometrics. 2000 Dec;56(4):1241-8
11129486
Psychol Methods. 2001 Dec;6(4):330-51
11778676
J Appl Psychol. 1993 Feb;78(1):119-28
8449850
J Youth Adolesc. 1987 Oct;16(5):427-54
24277469
Stat Med. 2007 Jul 20;26(16):3057-77
17256804
Multivariate Behav Res. 1996 Apr 1;31(2):197-218
26801456
Prev Sci. 2007 Sep;8(3):206-13
17549635
Multivariate Behav Res. 1998 Oct 1;33(4):545-71
26753828
Eval Rev. 2004 Oct;28(5):434-64
15358906
Dev Psychol. 2009 Jul;45(4):1195-9
19586189