title: Developing Internet-based health interventions: a guide for public health researchers and practitioners.
abstract: BACKGROUND
  Researchers and practitioners interested in developing online health interventions most often rely on Web-based and print resources to guide them through the process of online intervention development. Although useful for understanding many aspects of best practices for website development, missing from these resources are concrete examples of experiences in online intervention development for health apps from the perspective of those conducting online health interventions.
  
  
  OBJECTIVE
  This study aims to serve as a series of case studies in the development of online health interventions to provide insights for researchers and practitioners who are considering technology-based interventional or programmatic approaches.
  
  
  METHODS
  A convenience sample of six study coordinators and five principal investigators at a large, US-based land grant university were interviewed about the process of developing online interventions in the areas of alcohol policy, adolescent health, medication adherence, and human immunodeficiency virus prevention in transgender persons and in men who have sex with men. Participants were asked questions that broadly addressed each of the four phases of the User-Centered Design Process Map from the US Department of Health and Human Services' Research-Based Web Design & Usability Guidelines. Interviews were audio recorded and transcribed. Qualitative codes were developed using line-by-line open coding for all transcripts, and all transcripts were coded independently by at least 2 authors. Differences among coders were resolved with discussion.
  
  
  RESULTS
  We identified the following seven themes: (1) hire a strong (or at least the right) research team, (2) take time to plan before beginning the design process, (3) recognize that vendors and researchers have differing values, objectives, and language, (4) develop a detailed contract, (5) document all decisions and development activities, (6) use a content management system, and (7) allow extra time for testing and debugging your intervention. Each of these areas is discussed in detail, with supporting quotations from principal investigators and study coordinators.
  
  
  CONCLUSIONS
  The values held by members of each participating organization involved in the development of the online intervention or program, as well as the objectives that are trying to be met with the website, must be considered. These defined values and objectives should prompt an open and explicit discussion about the scope of work, budget, and other needs from the perspectives of each organization. Because of the complexity of developing online interventions, researchers and practitioners should become familiar with the process and how it may differ from the development and implementation of in-person interventions or programs. To assist with this, the intervention team should consider expanding the team to include experts in computer science or learning technologies, as well as taking advantage of institutional resources that will be needed for successful completion of the project. Finally, we describe the tradeoff between funds available for online intervention or program development and the complexity of the project.
authors: Division of Epidemiology and Community Health, University of Minnesota, Minneapolis, MN, United States. horva018@umn.edu.
authors: Keith J
authors: http://orcid.org/0000-0003-1372-7244
authors: KJ
authors: Horvath
authors: Alexandra M
authors: http://orcid.org/0000-0002-8822-701X
authors: AM
authors: Ecklund
authors: Shanda L
authors: http://orcid.org/0000-0002-4131-7333
authors: SL
authors: Hunt
authors: Toben F
authors: http://orcid.org/0000-0001-9934-7546
authors: TF
authors: Nelson
authors: Traci L
authors: http://orcid.org/0000-0003-1782-1342
authors: TL
authors: Toomey
mesh_terms: D000293:Adolescent; D016497:Adolescent Health Services; D054626:Consumer Health Information; D015658:HIV Infections / Q000517:prevention & control*; D015438:Health Behavior; D006293:Health Promotion / Q000379:methods*; D006801:Humans; D020407:Internet; D007407:Interviews as Topic; D008297:Male; D055118:Medication Adherence; D016730:Program Development; D011634:Public Health; D012108:Research Personnel; D063106:Transgender Persons; D005260:Female
keywords: Internet; development; intervention; public health
references: Comput Inform Nurs. 2013 May;31(5):219-26; quiz 227-8
references: 23542306
references: Prev Med. 2004 Nov;39(5):962-8
references: 15475030
references: BMC Med Inform Decis Mak. 2013;13:131
references: 24289731
references: Ann N Y Acad Sci. 2014 Jan;1308:54-67
references: 24673167
references: AIDS Care. 2012;24(8):945-52
references: 22519523
references: Ann Behav Med. 2006 Jun;31(3):205-23
references: 16700634
references: Curr HIV/AIDS Rep. 2007 Dec;4(4):201-7
references: 18366952
references: Acad Med. 2000 Oct;75(10):1025-8
references: 11031152
references: J Fam Pract. 1994 Sep;39(3):262-70
references: 8077905
references: Patient Educ Couns. 2013 Dec;93(3):459-63
references: 24215943
references: Annu Rev Public Health. 2009;30:273-92
references: 19296777
references: AIDS Behav. 2011 Feb;15(2):253-60
references: 20848305
references: Am J Health Promot. 2005 Jul-Aug;19(6):422-9
references: 16022206
references: JAMA. 2003 Apr 9;289(14):1833-6
references: 12684363
references: Am J Prev Med. 2007 Oct;33(4):336-345
references: 17888860
references: AIDS Care. 2011 May;23(5):525-33
references: 21287420
references: Addict Behav. 2006 Feb;31(2):264-77
references: 15950392
references: J Med Internet Res. 2012;14(3):e87
references: 22695686
references: JMIR Res Protoc. 2013 Jan 16;2(1):e3
references: 23612363