title: Developing an evidence-based methodological framework to systematically compare HTA coverage decisions: A mixed methods study.
abstract: Health Technology Assessment (HTA) often results in different coverage recommendations across countries for a same medicine despite similar methodological approaches. This paper develops and pilots a methodological framework that systematically identifies the reasons for these differences using an exploratory sequential mixed methods research design. The study countries were England, Scotland, Sweden and France. The methodological framework was built around three stages of the HTA process: (a) evidence, (b) its interpretation, and (c) its influence on the final recommendation; and was applied to two orphan medicinal products. The criteria accounted for at each stage were qualitatively analyzed through thematic analysis. Piloting the framework for two medicines, eight trials, 43 clinical endpoints and seven economic models were coded 155 times. Eighteen different uncertainties about this evidence were coded 28 times, 56% of which pertained to evidence commonly appraised and 44% to evidence considered by only some agencies. The poor agreement in interpreting this evidence (κ=0.183) was partly explained by stakeholder input (ns=48 times), or by agency-specific risk (nu=28 uncertainties) and value preferences (noc=62 "other considerations"), derived through correspondence analysis. Accounting for variability at each stage of the process can be achieved by codifying its existence and quantifying its impact through the application of this framework. The transferability of this framework to other disease areas, medicines and countries is ensured by its iterative and flexible nature, and detailed description.
authors.affiliation: London School of Economics and Political Science, Social Policy, LSE Health, Houghton Street, WC2A 2AE London, UK. Electronic address: e.m.nicod@lse.ac.uk.
authors.forename: Elena
authors.initials: E
authors.lastname: Nicod
authors.affiliation: London School of Economics and Political Science, Social Policy, LSE Health, Houghton Street, WC2A 2AE London, UK.
authors.forename: Panos
authors.initials: P
authors.lastname: Kanavos
mesh_terms: D003657:Decision Making; D005060:Europe; D055317:Evidence-Based Practice; D006291:Health Policy; D019458:Insurance Coverage; D009965:Orphan Drug Production; D013673:Technology Assessment, Biomedical / Q000379:methods*
keywords: Comparative analysis; England; France; Health technology assessment; Mixed methods; Orphan drugs; Scotland; Sweden; Thematic analysis