title: Implemented or not implemented? Process evaluation of the school-based obesity prevention program DOiT and associations with program effectiveness.
abstract: This study investigates if and to what extent the Dutch Obesity Intervention in Teenagers (DOiT) program was implemented as intended and how this affected program effectiveness. We collected data at 20 prevocational education schools in the Netherlands. We assessed seven process indicators: recruitment, reach, dosage, fidelity, satisfaction, effectiveness and continuation. Data collection involved teacher questionnaires (n= 110), adolescent questionnaires and adiposity measures (n= 938). Using multi-level confirmatory factor analyses, we applied an innovative method to obtain explorative implementation index scores. The percentage of accomplished activities ranged from 9% (for 'closure meeting') up to 93% (for 'obtaining support within the school for adoption'). The percentage of lessons delivered decreased from 74 to 18% towards the end of the program. Fidelity to the teacher manual ranged from 85 to 26%. In general, teachers were satisfied with the DOiT lessons and teaching materials. Despite teachers' satisfaction with the DOiT lessons and teaching materials, degree of program implementation was lower than expected, especially towards the end of the program. Further, some evidence was found for an association between a higher implementation index score and program effectiveness, but more research is needed to test the validity of the implementation index.
authors.affiliation: Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam 1081 BT, The Netherlands, f.vannassau@vumc.nl.
authors.forename: Femke
authors.initials: F
authors.lastname: van Nassau
authors.affiliation: Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam 1081 BT, The Netherlands.
authors.forename: Amika S
authors.initials: AS
authors.lastname: Singh
authors.affiliation: Department of Health Sciences, VU University, Amsterdam 1081 BT, The Netherlands and Department of Epidemiology and Biostatistics, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam 1081 BT, The Netherlands.
authors.forename: Trynke
authors.initials: T
authors.lastname: Hoekstra
authors.affiliation: Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam 1081 BT, The Netherlands.
authors.forename: Willem
authors.initials: W
authors.lastname: van Mechelen
authors.affiliation: Department of Epidemiology and Biostatistics, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam 1081 BT, The Netherlands.
authors.forename: Johannes
authors.initials: J
authors.lastname: Brug
authors.affiliation: Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam 1081 BT, The Netherlands.
authors.forename: Mai J M
authors.initials: MJ
authors.lastname: Chinapaw
mesh_terms: D050154:Adiposity; D000329:Advertising; D000072001:Diet, Healthy; D015444:Exercise; D005247:Feeding Behavior; D015438:Health Behavior; D006293:Health Promotion / Q000458:organization & administration*; D006801:Humans; D009426:Netherlands / Q000453:epidemiology; D063766:Pediatric Obesity / Q000517:prevention & control*; D015397:Program Evaluation; D012572:School Health Services / Q000458:organization & administration*