title: Methodological reviews of economic evaluations in health care: what do they target?
abstract: OBJECTIVE
  An increasing number of published studies of economic evaluations of health technologies have been reviewed and summarized with different purposes, among them to facilitate decision-making processes. These reviews have covered different aspects of economic evaluations, using a variety of methodological approaches. The aim of this study is to analyze the methodological characteristics of the reviews of economic evaluations in health care, published during the period 1990-2010, to identify their main features and the potential missing elements. This may help to develop a common procedure for elaborating these kinds of reviews.
  
  
  METHODS
  We performed systematic searches in electronic databases (Scopus, Medline and PubMed) of methodological reviews published in English, period 1990-2010. We selected the articles whose main purpose was to review and assess the methodology applied in the economic evaluation studies. We classified the data according to the study objectives, period of the review, number of reviewed studies, methodological and non-methodological items assessed, medical specialty, type of disease and technology, databases used for the review and their main conclusions. We performed a descriptive statistical analysis and checked how generalizability issues were considered in the reviews.
  
  
  RESULTS
  We identified 76 methodological reviews, 42 published in the period 1990-2001 and 34 during 2002-2010. The items assessed most frequently (by 70% of the reviews) were perspective, type of economic study, uncertainty and discounting. The reviews also described the type of intervention and disease, funding sources, country in which the evaluation took place, type of journal and author's characteristics. Regarding the intertemporal comparison, higher frequencies were found in the second period for two key methodological items: the source of effectiveness data and the models used in the studies. However, the generalizability issues that apparently are creating a growing interest in the economic evaluation literature did not receive as much attention in the reviews of the second period. The remaining items showed similar frequencies in both periods.
  
  
  CONCLUSIONS
  Increasingly more reviews of economic evaluation studies aim to analyze the application of methodological principles, and offer summaries of papers classified by either diseases or health technologies. These reviews are useful for finding literature trends, aims of studies and possible deficiencies in the implementation of methods of specific health interventions. As no significant methodological improvement was clearly detected in the two periods analyzed, it would be convenient to pay more attention to the methodological aspects of the reviews.
authors: Department of Economics, University of La Rioja, 26004, Logroño, Spain.
authors: Maria-Florencia
authors: MF
authors: Hutter
authors: Roberto
authors: R
authors: Rodríguez-Ibeas
authors: Fernando
authors: F
authors: Antonanzas
mesh_terms: D003362:Cost-Benefit Analysis / Q000379:methods*; D003695:Delivery of Health Care / Q000191:economics; D017048:Health Care Costs; D006801:Humans; D012196:Review Literature as Topic
references: Cad Saude Publica. 2009;25 Suppl 3:S401-14
references: 20027388
references: Ann Intern Med. 1992 Feb 1;116(3):238-44
references: 1530808
references: Value Health. 2005 Jan-Feb;8(1):3-9
references: 15841889
references: Ann Intern Med. 2000 Jun 20;132(12):964-72
references: 10858180
references: J Med Screen. 2000;7(2):59-73
references: 11002445
references: Med Decis Making. 1997 Oct-Dec;17(4):402-8
references: 9343798
references: BMC Health Serv Res. 2007 Jan 12;7:7
references: 17222334
references: Health Aff (Millwood). 2000 Mar-Apr;19(2):92-109
references: 10718025
references: J Manag Care Pharm. 2003 Jan-Feb;9(1):53-61
references: 14613362
references: Int J Technol Assess Health Care. 2006 Summer;22(3):327-37
references: 16984061
references: Int J Technol Assess Health Care. 2003 Fall;19(4):685-91
references: 15095774
references: Ann Surg. 2007 Jan;245(1):147-51
references: 17197978
references: Int J Technol Assess Health Care. 2000 Summer;16(3):731-42
references: 11028129
references: Health Econ. 2004 Dec;13(12):1203-10
references: 15386669
references: Trop Med Int Health. 2000 Apr;5(4):237-49
references: 10810015
references: Med Care. 2009 Jul;47(7 Suppl 1):S28-32
references: 19536023
references: Stroke. 2000 May;31(5):1046-53
references: 10797164
references: Pharmacoeconomics. 1997 Dec;12(6):685-94
references: 10175980
references: BMJ. 1996 Aug 3;313(7052):275-83
references: 8704542
references: Gynecol Oncol. 2004 Apr;93(1):1-8
references: 15047206
references: Health Econ. 1997 Mar-Apr;6(2):161-77
references: 9158968
references: Med Care. 1998 May;36(5 Suppl):MS1-9, MS18-147
references: 9599597
references: Health Technol Assess. 1999;3(9):i-iv, 1-164
references: 10392311
references: Med Care. 1993 Jul;31(7 Suppl):JS1-11, JS18-149
references: 8326780
references: Pharmacoeconomics. 1995 Jan;7(1):1-6
references: 10155289
references: Med Care. 2003 Jan;41(1):32-44
references: 12544542
references: J Arthroplasty. 2004 Feb;19(2):180-9
references: 14973861
references: PLoS One. 2009;4(2):e4548
references: 19229328
references: Crit Care Med. 2006 Nov;34(11):2738-47
references: 16957636
references: Pharmacoeconomics. 2008;26(1):17-32
references: 18088156
references: Pharmacoeconomics. 2004;22(13):857-76
references: 15329031
references: Expert Rev Pharmacoecon Outcomes Res. 2009 Aug;9(4):333-46
references: 19670994
references: Health Policy. 1992 Jul;21(3):249-79
references: 10120196
references: Int J Technol Assess Health Care. 2000 Winter;16(1):100-10
references: 10815357
references: Radiology. 2008 Dec;249(3):917-25
references: 19011188
references: Health Econ. 2009 Jun;18(6):629-43
references: 18677724
references: Drugs Aging. 1999;15 Suppl 1:31-6
references: 10690793
references: Int J Technol Assess Health Care. 2006 Fall;22(4):436-42
references: 16984676
references: Eur Spine J. 2006 Aug;15(8):1165-73
references: 16369828
references: Pharmacoeconomics. 2009;27(10):861-72
references: 19803540
references: Transfus Med Rev. 1999 Apr;13(2):106-17
references: 10218234
references: Health Policy. 2000 Mar;51(2):87-99
references: 10699677
references: Med Care Res Rev. 2005 Oct;62(5):503-43
references: 16177456
references: Nurs Res. 1999 Mar-Apr;48(2):94-104
references: 10190836
references: Value Health. 2000 Nov-Dec;3 Suppl 1:7-14
references: 16464205
references: J Med Econ. 2008;11(1):177-97
references: 19450119
references: Rev Esp Salud Publica. 2010 Jul-Aug;84(4):353-69
references: 21141264
references: Scand J Work Environ Health. 2010 Jun;36(4):273-88
references: 20473477
references: Int J Technol Assess Health Care. 2000 Winter;16(1):111-24
references: 10815358
references: Pharmacoeconomics. 2009;27(7):561-70
references: 19663527
references: Radiology. 1997 Apr;203(1):87-91
references: 9122421
references: J Clin Oncol. 2000 Sep 15;18(18):3302-17
references: 10986064
references: Q J Nucl Med. 2000 Jun;44(2):121-37
references: 10967623
references: Int J Technol Assess Health Care. 1999 Summer;15(3):480-96
references: 10874376
references: Pediatrics. 2005 May;115(5):e600-14
references: 15867026
references: Soc Sci Med. 1994 Jun;38(12):1601-7
references: 8047917
references: AIDS. 1998;12 Suppl A:S231-8
references: 9633007
references: Eur J Health Econ. 2010 Oct;11(5):513-20
references: 20405159
references: Pharmacoeconomics. 1994 Feb;5(2):123-9
references: 10146905
references: Clin Ther. 2009 Jun;31(6):1279-308
references: 19695395
references: Obstet Gynecol. 1998 Mar;91(3):472-8
references: 9491880
references: Health Policy. 1999 Mar;46(3):217-38
references: 10351669
references: Gac Sanit. 2007 Mar-Apr;21(2):150-61
references: 17419933
references: Int J Technol Assess Health Care. 1993 Winter;9(1):37-45
references: 8423115
references: Stroke. 1999 Jul;30(7):1340-9
references: 10390305
references: Int J Chron Obstruct Pulmon Dis. 2008;3(1):71-88
references: 18488430
references: Int J Technol Assess Health Care. 1998 Fall;14(4):799-808
references: 9885468
references: Int J Technol Assess Health Care. 1993 Winter;9(1):26-36
references: 8423113
references: J Arthroplasty. 1999 Aug;14(5):527-32
references: 10475549
references: Clin J Pain. 2007 Oct;23(8):726-33
references: 17885353
references: Am J Hosp Pharm. 1991 Dec;48(12):2622-7
references: 1814204
references: Lancet Infect Dis. 2005 Jun;5(6):383-91
references: 15919624
references: Pharmacoeconomics. 1999 Jul;16(1):17-31
references: 10539119
references: Int J Technol Assess Health Care. 2005 Spring;21(2):203-10
references: 15921060
references: Health Econ. 2000 Dec;9(8):681-98
references: 11137950
references: Pharmacoeconomics. 1995 Sep;8(3):245-52
references: 10155620
references: Pharmacoeconomics. 2005;23(2):113-20
references: 15748086
references: Am J Prev Med. 2000 Jul;19(1):15-23
references: 10865159
references: Health Econ. 2001 Dec;10(8):715-29
references: 11747053
references: J Epidemiol Community Health. 1998 Sep;52(9):586-94
references: 10320860
references: Health Policy. 1995 Feb;31(2):111-25
references: 10141252
references: Eur J Health Econ. 2005 Dec;6(4):334-46
references: 16249933
references: Pharmacoeconomics. 1998 Apr;13(4):411-20
references: 10178665
references: Clin Orthop Relat Res. 2007 Apr;457:42-8
references: 17242614
references: Gastroenterology. 2004 Aug;127(2):403-11
references: 15300571
references: J Natl Cancer Inst. 2010 Jan 20;102(2):82-8
references: 20056956
references: Br J Ophthalmol. 2010 Sep;94(9):1118-26
references: 20813751
references: JAMA. 2002 Jun 5;287(21):2809-12
references: 12038919