title: Empirically evaluating the impact of adjudicative tribunals in the health sector: context, challenges and opportunities.
abstract: Adjudicative tribunals are an integral part of health system governance, yet their real-world impact remains largely unknown. Most assessments focus on internal accountability and use anecdotal methodologies; few, studies if any, empirically evaluate their external impact and use these data to test effectiveness, track performance, inform service improvements and ultimately strengthen health systems. Given that such assessments would yield important benefits and have been conducted successfully in similar settings (e.g. specialist courts), their absence is likely attributable to complexity in the health system, methodological difficulties and the legal environment within which tribunals operate. We suggest practical steps for potential evaluators to conduct empirical impact evaluations along with an evaluation matrix template featuring possible target outcomes and corresponding surrogate endpoints, performance indicators and empirical methodologies. Several system-level strategies for supporting such assessments have also been suggested for academics, health system institutions, health planners and research funders. Action is necessary to ensure that policymakers do not continue operating without evidence but can rather pursue data-driven strategies that are more likely to achieve their health system goals in a cost-effective way.
authors.affiliation: Department of Clinical Epidemiology & Biostatistics, and Adjunct Faculty, McMaster Health Forum, McMaster University, Hamilton, Ontario, Canada. hoffmans@mcmaster.ca
authors.forename: Steven J
authors.initials: SJ
authors.lastname: Hoffman
authors.forename: Lorne
authors.initials: L
authors.lastname: Sossin
mesh_terms: D002170:Canada; D005069:Evaluation Studies as Topic; D006075:Governing Board / Q000331:legislation & jurisprudence / Q000458:organization & administration* / Q000592:standards; D018166:Health Care Reform / Q000458:organization & administration; D019981:Health Care Sector / Q000331:legislation & jurisprudence / Q000458:organization & administration* / Q000592:standards; D006302:Health Services Research / Q000331:legislation & jurisprudence / Q000458:organization & administration* / Q000592:standards; D006801:Humans; D011050:Policy Making; D036301:Qualitative Research; D011787:Quality of Health Care / Q000458:organization & administration; D012107:Research Design