title: Attempt to increase the transparency of fourth hurdle implementation in Central-Eastern European middle income countries: publication of the critical appraisal methodology.
abstract: BACKGROUND
  In middle income countries the number of trained health technology assessment specialists is limited and the public budget for health technology assessment is considerably lower compared to developed countries. These countries therefore must develop their own solutions to improve the quality and efficiency of health technology assessment implementation in reimbursement decisions. Our study aimed to develop a scientifically rigorous and detailed appraisal checklist for economic evaluations of pharmaceuticals in the single health technology assessment process.
  
  
  METHODS
  The research design entailed a review of economic evaluations, submitted for reimbursement of pharmaceuticals, by two independent academic reviewers to identify the most common methodological problems. Fifty economic evaluations submitted in 2007-2008, randomly selected by the Health Technology Assessment Office served as data sources. The new checklist was developed by an iterative working process: first by assessing ten economic evaluations, then improving the checklist by generating new question items, then employing the improved checklist to assess the next ten economic evaluations. After appraising 25 documents, the reviewers reconciled their opinions and improved the checklist with the researchers of the Health Technology Assessment Office during an expert panel discussion. The reviewers scrutinized the second 25 economic evaluations, after which the expert panel finalized the checklist with consensus.
  
  
  RESULTS
  The final checklist consists of 91 yes or no questions in 11 main topics concerning comparator selection, efficacy, effectiveness, costs, sensitivity analysis, methodological approach, transparency, and interpretation of results. The new checklist is based on current Hungarian evaluation practice. As the published checklist will be part of the official single health technology assessment process of pharmaceuticals, submitters will be able to assure the quality of their economic evaluation.
  
  
  CONCLUSIONS
  The transparent critical appraisal method should improve the consistency of pharmaceutical reimbursement decisions and facilitate the utilization of economic evaluations in other fields of health care decision-making in other Central-Eastern European countries.
authors.affiliation: University Pharmacy, Department of Pharmacy Administration, Semmelweis University, Budapest, Hungary. inotai.andras@gytk.sote.hu
authors.forename: András
authors.initials: A
authors.lastname: Inotai
authors.forename: Márta
authors.initials: M
authors.lastname: Pékli
authors.forename: Gabriella
authors.initials: G
authors.lastname: Jóna
authors.forename: Orsolya
authors.initials: O
authors.lastname: Nagy
authors.forename: Edit
authors.initials: E
authors.lastname: Remák
authors.forename: Zoltán
authors.initials: Z
authors.lastname: Kaló
mesh_terms: D057189:Checklist / Q000592:standards; D003362:Cost-Benefit Analysis / Q000191:economics / Q000592:standards; D003365:Costs and Cost Analysis; D003663:Decision Trees; D005061:Europe, Eastern; D019317:Evidence-Based Medicine; D006284:Health Plan Implementation; D006801:Humans; D006814:Hungary; D008390:Markov Chains; D012051:Reimbursement Mechanisms; D011795:Surveys and Questionnaires; D013673:Technology Assessment, Biomedical / Q000379:methods* / Q000592:standards; D013678:Technology, Pharmaceutical / Q000191:economics*