title: Reporting bias in medical research - a narrative review.
abstract: Reporting bias represents a major problem in the assessment of health care interventions. Several prominent cases have been described in the literature, for example, in the reporting of trials of antidepressants, Class I anti-arrhythmic drugs, and selective COX-2 inhibitors. The aim of this narrative review is to gain an overview of reporting bias in the medical literature, focussing on publication bias and selective outcome reporting. We explore whether these types of bias have been shown in areas beyond the well-known cases noted above, in order to gain an impression of how widespread the problem is. For this purpose, we screened relevant articles on reporting bias that had previously been obtained by the German Institute for Quality and Efficiency in Health Care in the context of its health technology assessment reports and other research work, together with the reference lists of these articles.We identified reporting bias in 40 indications comprising around 50 different pharmacological, surgical (e.g. vacuum-assisted closure therapy), diagnostic (e.g. ultrasound), and preventive (e.g. cancer vaccines) interventions. Regarding pharmacological interventions, cases of reporting bias were, for example, identified in the treatment of the following conditions: depression, bipolar disorder, schizophrenia, anxiety disorder, attention-deficit hyperactivity disorder, Alzheimer's disease, pain, migraine, cardiovascular disease, gastric ulcers, irritable bowel syndrome, urinary incontinence, atopic dermatitis, diabetes mellitus type 2, hypercholesterolaemia, thyroid disorders, menopausal symptoms, various types of cancer (e.g. ovarian cancer and melanoma), various types of infections (e.g. HIV, influenza and Hepatitis B), and acute trauma. Many cases involved the withholding of study data by manufacturers and regulatory agencies or the active attempt by manufacturers to suppress publication. The ascertained effects of reporting bias included the overestimation of efficacy and the underestimation of safety risks of interventions.In conclusion, reporting bias is a widespread phenomenon in the medical literature. Mandatory prospective registration of trials and public access to study data via results databases need to be introduced on a worldwide scale. This will allow for an independent review of research data, help fulfil ethical obligations towards patients, and ensure a basis for fully-informed decision making in the health care system.
authors.affiliation: Institute for Quality and Efficiency in Health Care, Dillenburger Str 27, 51105 Cologne, Germany. n.mcgauran@iqwig.de
authors.forename: Natalie
authors.initials: N
authors.lastname: McGauran
authors.forename: Beate
authors.initials: B
authors.lastname: Wieseler
authors.forename: Julia
authors.initials: J
authors.lastname: Kreis
authors.forename: Yvonne-Beatrice
authors.initials: YB
authors.lastname: Schüler
authors.forename: Heike
authors.initials: H
authors.lastname: Kölsch
authors.forename: Thomas
authors.initials: T
authors.lastname: Kaiser
mesh_terms: D022126:Access to Information; D000818:Animals; D035843:Biomedical Research; D003257:Consumer Product Safety; D019992:Databases as Topic; D019317:Evidence-Based Medicine; D006801:Humans; D010506:Periodicals as Topic; D017594:Publication Bias; D012042:Registries; D015203:Reproducibility of Results; D016896:Treatment Outcome; D014342:Truth Disclosure
references.citation: Can J Psychiatry. 2004 Sep;49(9):601-6
references.pmid: 15503731
references.citation: CMAJ. 2004 Sep 28;171(7):735-40
references.pmid: 15451835
references.citation: CMAJ. 2004 Feb 17;170(4):477-80
references.pmid: 14970094
references.citation: BMJ. 2008 Mar 8;336(7643):532-4
references.pmid: 18304990
references.citation: Swiss Med Wkly. 2008 Apr 5;138(13-14):197-203
references.pmid: 18389392
references.citation: J Clin Oncol. 1986 Oct;4(10):1529-41
references.pmid: 3760920
references.citation: Arch Intern Med. 1989 Dec;149(12):2694-8
references.pmid: 2688587
references.citation: N Engl J Med. 1995 Oct 26;333(17):1099-105
references.pmid: 7565947
references.citation: BMJ. 2009 Dec 08;339:b5106
references.pmid: 19995812
references.citation: Eur J Cancer. 2007 Nov;43(17):2559-79
references.pmid: 17981458
references.citation: BMJ. 2007 Nov 17;335(7628):1015
references.pmid: 18006992
references.citation: N Engl J Med. 2008 Apr 3;358(14):1431-43
references.pmid: 18376000
references.citation: Diabetes Care. 2008 Mar;31(3):e10
references.pmid: 18308673
references.citation: JAMA. 1997 Apr 16;277(15):1238-43
references.pmid: 9103350
references.citation: Br J Cancer. 2003 Oct 20;89(8):1405-8
references.pmid: 14562007
references.citation: BMJ. 1998 Jul 25;317(7153):235-40
references.pmid: 9677209
references.citation: N Engl J Med. 2008 Jan 17;358(3):252-60
references.pmid: 18199864
references.citation: BMJ. 2005 Apr 23;330(7497):956-8
references.pmid: 15845980
references.citation: J Natl Cancer Inst. 2005 Jul 20;97(14):1043-55
references.pmid: 16030302
references.citation: Online J Curr Clin Trials. 1993 Apr 28;Doc No 50:[4967 words; 53 paragraphs]
references.pmid: 8306005
references.citation: Curr Control Trials Cardiovasc Med. 2001;2(5):205-207
references.pmid: 11806796
references.citation: BMJ. 2007 Jan 20;334(7585):120-3
references.pmid: 17235089
references.citation: MMW Fortschr Med. 2006 Oct 26;148(43):8
references.pmid: 17619412
references.citation: Br Med J. 1980 Mar 22;280(6217):833-6
references.pmid: 7370687
references.citation: J Gen Intern Med. 1998 Sep;13(9):600-6
references.pmid: 9754515
references.citation: Control Clin Trials. 1997 Oct;18(5):431-44
references.pmid: 9315426
references.citation: BMJ. 1995 May 20;310(6990):1313-5
references.pmid: 7773049
references.citation: Cochrane Database Syst Rev. 2009 Jan 21;(1):MR000006
references.pmid: 19160345
references.citation: JAMA. 2008 Apr 16;299(15):1833-5
references.pmid: 18413880
references.citation: BMJ. 2001 Aug 25;323(7310):415
references.pmid: 11520825
references.citation: Lancet. 2008 Jul 19;372(9634):201
references.pmid: 18640445
references.citation: Cochrane Database Syst Rev. 2007 Apr 18;(2):MR000010
references.pmid: 17443631
references.citation: N Engl J Med. 2005 Dec 29;353(26):2813-4
references.pmid: 16339408
references.citation: JAMA. 1998 Jul 15;280(3):254-7
references.pmid: 9676673
references.citation: JAMA. 2003 Jul 23;290(4):495-501
references.pmid: 12876092
references.citation: Br J Psychiatry. 2003 Dec;183:498-506
references.pmid: 14645020
references.citation: BMC Med Res Methodol. 2008 Feb 11;8:4
references.pmid: 18267008
references.citation: Lancet. 2003 Mar 22;361(9362):1015-6
references.pmid: 12660062
references.citation: JAMA. 2003 Nov 19;290(19):2534
references.pmid: 14625316
references.citation: N Engl J Med. 2005 Apr 28;352(17):1739-41
references.pmid: 15858180
references.citation: JAMA. 1990 Mar 9;263(10):1405-8
references.pmid: 2304220
references.citation: BMJ. 2002 Aug 3;325(7358):249
references.pmid: 12153921
references.citation: J Clin Epidemiol. 2002 Apr;55(4):407-10
references.pmid: 11927210
references.citation: N Engl J Med. 2007 Jun 28;356(26):2734-6
references.pmid: 17548427
references.citation: N Engl J Med. 2006 Nov 23;355(21):2171-3
references.pmid: 17124013
references.citation: PLoS Med. 2004 Dec;1(3):e60
references.pmid: 15562322
references.citation: N Engl J Med. 2007 Aug 30;357(9):844-6
references.pmid: 17687124
references.citation: N Engl J Med. 2009 Jan 8;360(2):103-6
references.pmid: 19129523
references.citation: J Natl Cancer Inst. 1989 Jan 18;81(2):107-15
references.pmid: 2642556
references.citation: JAMA. 2003 Jan 22-29;289(4):454-65
references.pmid: 12533125
references.citation: BMJ. 2003 Mar 8;326(7388):518
references.pmid: 12623898
references.citation: J Manag Care Pharm. 2003 Nov-Dec;9(6):559-68
references.pmid: 14664664
references.citation: N Engl J Med. 2007 Jul 5;357(1):28-38
references.pmid: 17551159
references.citation: JAMA. 2001 Aug 22-29;286(8):954-9
references.pmid: 11509060
references.citation: Am J Psychiatry. 2006 Feb;163(2):185-94
references.pmid: 16449469
references.citation: BMJ. 2009 Jun 22;338:b2521
references.pmid: 19546133
references.citation: BMJ. 2004 Jun 26;328(7455):1513
references.pmid: 15217848
references.citation: Br Med J (Clin Res Ed). 1987 Sep 12;295(6599):654-6
references.pmid: 3117277
references.citation: JAMA. 1988 Oct 7;260(13):1910-6
references.pmid: 3047448
references.citation: J Bone Joint Surg Am. 2008 Mar;90(3):595-601
references.pmid: 18310710
references.citation: JAMA. 2007 Sep 12;298(10):1189-95
references.pmid: 17848653
references.citation: Croat Med J. 2008 Apr;49(2):267-8
references.pmid: 18461682
references.citation: BMJ. 2008 Jan 26;336(7637):170
references.pmid: 18219000
references.citation: Nature. 2003 Jun 19;423(6942):792
references.pmid: 12815392
references.citation: BMJ. 2003 May 31;326(7400):1171-3
references.pmid: 12775615
references.citation: BMC Res Notes. 2009 Jan 10;2:5
references.pmid: 19134216
references.citation: Cancer. 1987 Dec 1;60(11):2811-5
references.pmid: 3315175
references.citation: Chest. 2009 Jul;136(1):295-303
references.pmid: 19584212
references.citation: Br J Psychiatry. 2003 Aug;183:161-6
references.pmid: 12893670
references.citation: J Clin Epidemiol. 2003 Jan;56(1):44-51
references.pmid: 12589869
references.citation: CMAJ. 2002 Jun 25;166(13):1649-50
references.pmid: 12126315
references.citation: JAMA. 2008 Apr 16;299(15):1800-12
references.pmid: 18413874
references.citation: JAMA. 1992 Jan 15;267(3):374-8
references.pmid: 1727960
references.citation: PLoS Med. 2008 Sep 23;5(9):e191
references.pmid: 18816163
references.citation: J Med Ethics. 2008 Sep;34(9):e20
references.pmid: 18757621
references.citation: Lancet. 2000 Mar 25;355(9209):1035-40
references.pmid: 10744088
references.citation: J Am Acad Dermatol. 2005 Jun;52(6):967-71
references.pmid: 15928613
references.citation: N Engl J Med. 2009 Feb 19;360(8):824-30
references.pmid: 19228628
references.citation: JAMA. 2003 Aug 20;290(7):921-8
references.pmid: 12928469
references.citation: JAMA. 1998 Jul 15;280(3):250-3
references.pmid: 9676672
references.citation: N Engl J Med. 2007 Jul 5;357(1):63-4
references.pmid: 17551160
references.citation: JAMA. 2006 May 17;295(19):2270-4
references.pmid: 16705108
references.citation: JAMA. 2005 Apr 20;293(15):1900-5
references.pmid: 15840865
references.citation: N Engl J Med. 2004 Oct 21;351(17):1707-9
references.pmid: 15470193
references.citation: Medscape J Med. 2008;10(9):211
references.pmid: 19008973
references.citation: BMJ. 2005 Apr 2;330(7494):753
references.pmid: 15681569
references.citation: BMJ. 1997 Sep 13;315(7109):635-40
references.pmid: 9310564
references.citation: N Engl J Med. 2007 Jun 14;356(24):2457-71
references.pmid: 17517853
references.citation: BMJ. 2009 Jun 25;338:b2473
references.pmid: 19556275
references.citation: N Engl J Med. 1996 Feb 8;334(6):392-4
references.pmid: 8538713
references.citation: Lancet. 2004 Apr 24;363(9418):1341-5
references.pmid: 15110490
references.citation: Isr Med Assoc J. 2006 Jul;8(7):451-4
references.pmid: 16889157
references.citation: JAMA. 2002 Jan 23-30;287(4):473-80
references.pmid: 11798369
references.citation: N Engl J Med. 2007 Jun 14;356(24):2522-4
references.pmid: 17517854
references.citation: Lancet. 2006 Dec 9;368(9552):2049; author reply 2050-1
references.pmid: 17161720
references.citation: Psychol Med. 2006 Nov;36(11):1647-56
references.pmid: 16893480
references.citation: N Engl J Med. 2007 Apr 19;356(16):1601-4
references.pmid: 17442902
references.citation: Med J Aust. 2006 Jun 19;184(12):621-6
references.pmid: 16803442
references.citation: Lancet. 1999 Mar 6;353(9155):771-2
references.pmid: 10459956
references.citation: BMC Med Res Methodol. 2002 Apr 26;2:7
references.pmid: 11978183
references.citation: Ann Intern Med. 2008 Aug 19;149(4):251-8
references.pmid: 18711155
references.citation: Cochrane Database Syst Rev. 2006 Jul 19;(3):CD001265
references.pmid: 16855962
references.citation: Drug Saf. 2006;29(5):385-96
references.pmid: 16689555
references.citation: JAMA. 2001 Jan 24-31;285(4):437-43
references.pmid: 11242428
references.citation: N Engl J Med. 2005 Jun 9;352(23):2436-8
references.pmid: 15911780
references.citation: Lancet. 1985 Oct 12;2(8459):793-5
references.pmid: 2864530
references.citation: Cochrane Database Syst Rev. 2007 Apr 18;(2):MR000005
references.pmid: 17443628
references.citation: BMJ. 2008 May 31;336(7655):1208-9
references.pmid: 18511780
references.citation: CMAJ. 2004 Feb 17;170(4):487-9
references.pmid: 14970096
references.citation: JAMA. 2004 Dec 1;292(21):2622-31
references.pmid: 15572720
references.citation: BMJ. 2003 Dec 13;327(7428):1358-9
references.pmid: 14670851
references.citation: CMAJ. 2001 Sep 4;165(5):632
references.pmid: 11563216
references.citation: Lancet. 2002 Oct 5;360(9339):1071-3
references.pmid: 12383990
references.citation: JAMA. 2004 Dec 1;292(21):2655-7; discussion 2658-9
references.pmid: 15572725
references.citation: Cochrane Database Syst Rev. 2003;(2):CD003592
references.pmid: 12804478
references.citation: Oncologist. 2008 Sep;13(9):930-2
references.pmid: 18794215
references.citation: Health Aff (Millwood). 2007 Mar-Apr;26(2):483-91
references.pmid: 17339677
references.citation: Control Clin Trials. 1987 Dec;8(4):343-53
references.pmid: 3442991
references.citation: N Engl J Med. 2004 Sep 16;351(12):1250-1
references.pmid: 15356289
references.citation: JAMA. 2008 Feb 27;299(8):885-7
references.pmid: 18314425
references.citation: BMC Clin Pharmacol. 2001;1:3
references.pmid: 11591227
references.citation: PLoS Med. 2005 Nov;2(11):e378
references.pmid: 16221000
references.citation: BMJ. 2004 Jun 12;328(7453):1395
references.pmid: 15191963
references.citation: CMAJ. 2004 Feb 17;170(4):489-91
references.pmid: 14970097
references.citation: BMJ. 2002 Sep 14;325(7364):592-5
references.pmid: 12228140
references.citation: N Engl J Med. 2006 Jan 26;354(4):353-65
references.pmid: 16436767
references.citation: Oncologist. 2008 Sep;13(9):925-9
references.pmid: 18794216
references.citation: JAMA. 1998 Jan 28;279(4):281-6
references.pmid: 9450711
references.citation: Transfusion. 2006 Mar;46(3):327-38
references.pmid: 16533273
references.citation: JAMA. 2008 Feb 27;299(8):953-5
references.pmid: 18314439
references.citation: N Engl J Med. 2009 Nov 12;361(20):1963-71
references.pmid: 19907043
references.citation: Lancet. 1997 Aug 2;350(9074):326-9
references.pmid: 9251637
references.citation: Ann Intern Med. 2006 Aug 15;145(4):284-93
references.pmid: 16908919
references.citation: BMJ. 2003 May 31;326(7400):1167-70
references.pmid: 12775614
references.citation: PLoS Med. 2007 Apr;4(4):e134
references.pmid: 17455990
references.citation: BMJ. 1997 Apr 19;314(7088):1145
references.pmid: 9146378
references.citation: Chest. 2009 Jul;136(1):304-305
references.pmid: 19584213
references.citation: N Engl J Med. 2000 Nov 23;343(21):1520-8, 2 p following 1528
references.pmid: 11087881
references.citation: JAMA. 2008 Apr 16;299(15):1813-7
references.pmid: 18413875
references.citation: Science. 2008 Oct 3;322(5898):44-6
references.pmid: 18832629
references.citation: JAMA. 1999 Nov 10;282(18):1752-9
references.pmid: 10568648
references.citation: BMJ. 2002 Sep 7;325(7363):528-31
references.pmid: 12217994
references.citation: BMJ. 2009 May 11;338:b1914
references.pmid: 19433504
references.citation: PLoS One. 2008 Aug 28;3(8):e3081
references.pmid: 18769481
references.citation: BMJ. 2005 Jul 2;331(7507):19
references.pmid: 15967761
references.citation: Am J Psychiatry. 2009 Feb;166(2):140-5
references.pmid: 19188290
references.citation: N Engl J Med. 1989 Aug 10;321(6):406-12
references.pmid: 2473403
references.citation: Contemp Clin Trials. 2008 Mar;29(2):109-13
references.pmid: 17919992
references.citation: JAMA. 1998 May 20;279(19):1566-70
references.pmid: 9605902
references.citation: Circulation. 2005 Sep 27;112(13):2040-2
references.pmid: 16172264
references.citation: Control Clin Trials. 2004 Dec;25(6):598-612
references.pmid: 15588746
references.citation: JAMA. 1997 Apr 16;277(15):1205-13
references.pmid: 9103344
references.citation: Cochrane Database Syst Rev. 2007 Apr 18;(2):MR000011
references.pmid: 17443632
references.citation: Am J Cardiol. 1983 Sep 22;52(6):32C-36C
references.pmid: 6353896
references.citation: PLoS Med. 2008 Nov 25;5(11):e217; discussion e217
references.pmid: 19067477
references.citation: Pharmacoepidemiol Drug Saf. 2005 Feb;14(2):101-6
references.pmid: 15386705
references.citation: BMJ. 2005 Jul 9;331(7508):70
references.pmid: 16002878
references.citation: Lancet. 2009 Jun 20;373(9681):2125-35
references.pmid: 19501900
references.citation: Br J Clin Pharmacol. 1998 Aug;46(2):147-50
references.pmid: 9723823
references.citation: Lancet. 1991 Apr 13;337(8746):867-72
references.pmid: 1672966
references.citation: Int J Cardiol. 1993 Jul 1;40(2):161-6
references.pmid: 8349379
references.citation: Am J Psychiatry. 2005 Oct;162(10):1957-60
references.pmid: 16199844
references.citation: Lancet. 1987 May 9;1(8541):1091
references.pmid: 2883426
references.citation: BMJ. 1997 Sep 13;315(7109):640-5
references.pmid: 9310565
references.citation: JAMA. 2002 Jun 5;287(21):2825-8
references.pmid: 12038924
references.citation: N Engl J Med. 2007 Jul 5;357(1):67-9
references.pmid: 17551162
references.citation: BMJ. 2004 Oct 9;329(7470):816
references.pmid: 15472245
references.citation: JAMA. 2000 Sep 13;284(10):1247-55
references.pmid: 10979111
references.citation: Health Technol Assess. 2000;4(10):1-115
references.pmid: 10932019
references.citation: Lancet. 2004 Dec 4-10;364(9450):2021-9
references.pmid: 15582059
references.citation: CNS Drugs. 2004;18(6):355-64; discussion 365-6
references.pmid: 15089103
references.citation: Control Clin Trials. 1988 Mar;9(1):76-81
references.pmid: 3356154
references.citation: Lancet Oncol. 2009 Feb;10(2):135-46
references.pmid: 19167925
references.citation: BMJ. 2008 Jan 26;336(7637):180-1
references.pmid: 18219028
references.citation: BMJ. 2006 Oct 14;333(7572):782
references.pmid: 17028106
references.citation: J Clin Epidemiol. 1995 May;48(5):713-9
references.pmid: 7730926
references.citation: JAMA. 2004 May 26;291(20):2457-65
references.pmid: 15161896
references.citation: Arch Intern Med. 2003 Jul 28;163(14):1667-72
references.pmid: 12885681
references.citation: JAMA. 2006 Sep 13;296(10):1266-73
references.pmid: 16968851
references.citation: JAMA. 1997 May 28;277(20):1597-604
references.pmid: 9168289
references.citation: BMJ. 2006 Jul 8;333(7558):92-5
references.pmid: 16825234
references.citation: Epidemiology. 2005 Mar;16(2):155-63
references.pmid: 15703529
references.citation: Med J Aust. 2005 Jun 6;182(11):557-60
references.pmid: 15938681
references.citation: Lancet. 2000 Dec 9;356(9246):2009-10
references.pmid: 11130544
references.citation: Bull World Health Organ. 2006 Jan;84(1):10-1
references.pmid: 16501708
references.citation: JAMA. 2006 Apr 12;295(14):1645-6
references.pmid: 16609085
references.citation: Science. 1996 Jul 26;273(5274):411
references.pmid: 8677431
references.citation: N Engl J Med. 2007 Jul 5;357(1):64-6
references.pmid: 17551161
references.citation: Lancet. 2000 Oct 7;356(9237):1228-31
references.pmid: 11072941
references.citation: N Engl J Med. 2005 Jun 23;352(25):2576-8
references.pmid: 15972862
references.citation: Health Technol Assess. 2008 Oct;12(32):iii, ix-x, 1-46
references.pmid: 18831948
references.citation: Cancer. 2007 Apr 1;109(7):1239-46
references.pmid: 17326054
references.citation: BMJ. 2009 Dec 08;339:b5351
references.pmid: 19995815
references.citation: PLoS Med. 2008 Feb;5(2):e45
references.pmid: 18303940
references.citation: JAMA. 2003 Jul 23;290(4):516-23
references.pmid: 12876095
references.citation: Lancet. 2001 May 19;357(9268):1544-5
references.pmid: 11377636
references.citation: Science. 1997 Feb 7;275(5301):777-80
references.pmid: 9036541