title: Second Global Symposium on Health Systems Research: a conference impact evaluation.
abstract: Evaluation researchers have confirmed the importance of conference evaluation, but there remains little research on the topic, perhaps in part because evaluation methodology related to conference impact is underdeveloped. We conducted a study evaluating a 4-day long health conference, the Second Global Symposium on Health Systems Research (HSR), which took place in Beijing in November 2012. Using a conference evaluation framework and a mixed-methods approach that involved in-conference surveys, in-conference interviews and 7-month post-conference interviews, we evaluated the impact of the Symposium on attendees' work and the field of health systems research. The three major impacts on participants' work were new knowledge, new skills and new networks, and many participants were able to provide examples of how obtaining new knowledge, skills or collaborations had changed the way they conduct their work. Participants noted that the Symposium influenced the field of HSR only in so far as it influenced the capacity of stakeholders, but did not lead to any high level agenda or policy changes, perhaps due to the insufficient length of time (7 months) between the Symposium and post-conference follow-up. This study provides an illustration of a framework useful for conference organizers in the evaluation of future conferences, and of a unique methodology for evaluation researchers.
authors.affiliation: Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Political Science, London WC2A 2AE, UK, Department of Medicine, Queens University, Kingston, ON, K7L 3N6, Canada and Technical Officer, Alliance for Health Policy and Systems Research, WHO, Geneva, 1211, Switzerland Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Poli
authors.forename: Emily
authors.initials: E
authors.lastname: Milko
authors.affiliation: Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Political Science, London WC2A 2AE, UK, Department of Medicine, Queens University, Kingston, ON, K7L 3N6, Canada and Technical Officer, Alliance for Health Policy and Systems Research, WHO, Geneva, 1211, Switzerland Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Poli
authors.forename: Diane
authors.initials: D
authors.lastname: Wu
authors.affiliation: Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Political Science, London WC2A 2AE, UK, Department of Medicine, Queens University, Kingston, ON, K7L 3N6, Canada and Technical Officer, Alliance for Health Policy and Systems Research, WHO, Geneva, 1211, Switzerland Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Poli
authors.forename: Justin
authors.initials: J
authors.lastname: Neves
authors.affiliation: Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Political Science, London WC2A 2AE, UK, Department of Medicine, Queens University, Kingston, ON, K7L 3N6, Canada and Technical Officer, Alliance for Health Policy and Systems Research, WHO, Geneva, 1211, Switzerland Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Poli
authors.forename: Alexander Wolfgang
authors.initials: AW
authors.lastname: Neubecker
authors.affiliation: Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Political Science, London WC2A 2AE, UK, Department of Medicine, Queens University, Kingston, ON, K7L 3N6, Canada and Technical Officer, Alliance for Health Policy and Systems Research, WHO, Geneva, 1211, Switzerland Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Poli
authors.forename: John
authors.initials: J
authors.lastname: Lavis
authors.affiliation: Michael DeGroote School of Medicine, McMaster University, Hamilton, ON, L8S 4K1, Canada, McMaster Health Forum, Hamilton, ON, L8S 4L6, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, ON, M5G 1V7, Canada, Department of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada, Department of Health Policy and Management, Harvard University, Cambridge, MA, 2115, USA, Faculte de Medecine, University of Geneva, Geneva, 1211, Switzerland, School of Biological Sciences, Royal Holloway, University of London, Surrey, TW20 0EX, UK, Program in Policy Decision-Making, Hamilton, ON, L8S 4K1, Canada, Centre for Health Economics and Policy Analysis, Hamilton, ON, L8S 4K1, Canada, Department of Clinical Epidemiology & Biostatistics, McMaster University, Hamilton, ON, L8S 4K1, Canada,Department of Social Policy, London School of Economics and Political Science, London WC2A 2AE, UK, Department of Medicine, Queens University, Kingston, ON, K7L 3N6, Canada and Technical Officer, Alliance for Health Policy and Systems Research, WHO, Geneva, 1211, Switzerland.
authors.forename: Michael Kent
authors.initials: MK
authors.lastname: Ranson
mesh_terms: D000293:Adolescent; D000328:Adult; D000068476:Beijing; D003226:Congresses as Topic / Q000706:statistics & numerical data; D003695:Delivery of Health Care; D005260:Female; D006302:Health Services Research; D006801:Humans; D008297:Male; D008875:Middle Aged; D011795:Surveys and Questionnaires; D055815:Young Adult
keywords: Evaluation methods; conferences; health systems research; indicators of success; meetings