title: Assessing the impact of health technology assessment in The Netherlands.
abstract: OBJECTIVE
  Investments in health research should lead to improvements in health and health care. This is also the remit of the main HTA program in the Netherlands. The aims of this study were to assess whether the results of this program have led to such improvements and to analyze how best to assess the impact from health research.
  
  
  METHODS
  We assessed the impact of individual HTA projects by adapting the "payback framework" developed in the United Kingdom. We conducted dossier reviews and sent a survey to principal investigators of forty-three projects awarded between 2000 and 2003. We then provided an overview of documented output and outcome that was assessed by ten HTA experts using a scoring method. Finally, we conducted five case studies using information from additional dossier review and semistructured key informant interviews.
  
  
  RESULTS
  The findings confirm that the payback framework is a useful approach to assess the impact of HTA projects. We identified over 101 peer reviewed papers, more than twenty-five PhDs, citations of research in guidelines (six projects), and implementation of new treatment strategies (eleven projects). The case studies provided greater depth and understanding about the levels of impact that arise and why and how they have been achieved.
  
  
  CONCLUSIONS
  It is generally too early to determine whether the HTA program led to actual changes in healthcare policy and practice. However, the results can be used as a baseline measurement for future evaluation and can help funding organizations or HTA agencies consider how to assess impact, possibly routinely. This, in turn, could help inform research strategies and justify expenditure for health research.
authors.affiliation: Department of Marco & Sector Policies, ECORYS Nederland BV, Rotterdam, The Netherlands. wija.oortwijn@ecorys.com
authors.forename: Wija J
authors.initials: WJ
authors.lastname: Oortwijn
authors.forename: Stephen R
authors.initials: SR
authors.lastname: Hanney
authors.forename: Andreas
authors.initials: A
authors.lastname: Ligtvoet
authors.forename: Stijn
authors.initials: S
authors.lastname: Hoorens
authors.forename: Steven
authors.initials: S
authors.lastname: Wooding
authors.forename: Jonathan
authors.initials: J
authors.lastname: Grant
authors.forename: Martin J
authors.initials: MJ
authors.lastname: Buxton
authors.forename: Lex M
authors.initials: LM
authors.lastname: Bouter
mesh_terms: D003625:Data Collection; D006302:Health Services Research; D007407:Interviews as Topic; D009426:Netherlands; D019982:Organizational Case Studies; D011787:Quality of Health Care; D013673:Technology Assessment, Biomedical; D006113:United Kingdom