title: Methods to assess youth engagement in a text messaging supplement to an effective teen pregnancy program.
abstract: Youth are prolific users of cell phone minutes and text messaging. Numerous programs using short message service text messaging (SMS) have been employed to help improve health behaviors and health outcomes. However, we lack information on whether and what type of interaction or engagement with SMS program content is required to realize any benefit. We explored youth engagement with an automated SMS program designed to supplement a 25-session youth development program with demonstrated efficacy for reductions in teen pregnancy. Using two years of program data, we report on youth participation in design of message content and response frequency to messages among youth enrolled in the intervention arm of a randomized controlled trial (RCT) as one indicator of engagement. There were 221 youth between the ages of 14-18 enrolled over two years in the intervention arm of the RCT. Just over half (51%) were female; 56% were Hispanic; and 27% African American. Youth were sent 40,006 messages of which 16,501 were considered bi-directional where youth were asked to text a response. Four-fifths (82%) responded at least once to a text. We found variations in response frequency by gender, age, and ethnicity. The most popular types of messages youth responded to include questions and quizzes. The first two months of the program in each year had the highest response frequency. An important next step is to assess whether higher response to SMS results in greater efficacy. This future work can facilitate greater attention to message design and content to ensure messages are engaging for the intended audience.
authors.affiliation: University of Colorado, Colorado School of Public Health, Department of Community and Behavioral Health, Denver, CO, United States.
authors.forename: Sharon
authors.initials: S
authors.lastname: Devine
authors.affiliation: Denver Health and Hospital Authority, Denver Public Health, Denver, CO, United States.
authors.forename: Caroline
authors.initials: C
authors.lastname: Leeds
authors.affiliation: Denver Health and Hospital Authority, Denver Public Health, Denver, CO, United States; University of Colorado, School of Medicine, Department of Family Medicine, Aurora, CO, United States.
authors.forename: Judith C
authors.initials: JC
authors.lastname: Shlay
authors.affiliation: Denver Health and Hospital Authority, Denver Public Health, Denver, CO, United States.
authors.forename: Amber
authors.initials: A
authors.lastname: Leytem
authors.affiliation: Denver Health and Hospital Authority, Denver Public Health, Denver, CO, United States.
authors.forename: Robert
authors.initials: R
authors.lastname: Beum
authors.affiliation: University of Colorado, Colorado School of Public Health, Department of Community and Behavioral Health, Denver, CO, United States. Electronic address: sheana.bull@ucdenver.edu.
authors.forename: Sheana
authors.initials: S
authors.lastname: Bull
mesh_terms: D000293:Adolescent; D001331:Automation; D040421:Cell Phone; D003625:Data Collection; D005260:Female; D015438:Health Behavior; D006293:Health Promotion / Q000379:methods*; D006630:Hispanic or Latino; D006801:Humans; D008297:Male; D010358:Patient Participation; D011247:Pregnancy; D011253:Pregnancy in Adolescence / Q000517:prevention & control*; D016730:Program Development; D015397:Program Evaluation / Q000379:methods*; D016032:Randomized Controlled Trials as Topic; D012725:Sexual Behavior; D060145:Text Messaging
keywords: Health behavior; SMS engagement; SMS programs; SMS response; Text messaging