title: Transparency and Reproducibility of Observational Cohort Studies Using Large Healthcare Databases.
abstract: The scientific community and decision-makers are increasingly concerned about transparency and reproducibility of epidemiologic studies using longitudinal healthcare databases. We explored the extent to which published pharmacoepidemiologic studies using commercially available databases could be reproduced by other investigators. We identified a nonsystematic sample of 38 descriptive or comparative safety/effectiveness cohort studies. Seven studies were excluded from reproduction, five because of violation of fundamental design principles, and two because of grossly inadequate reporting. In the remaining studies, >1,000 patient characteristics and measures of association were reproduced with a high degree of accuracy (median differences between original and reproduction <2% and <0.1). An essential component of transparent and reproducible research with healthcare databases is more complete reporting of study implementation. Once reproducibility is achieved, the conversation can be elevated to assess whether suboptimal design choices led to avoidable bias and whether findings are replicable in other data sources.
authors.affiliation: Division of Pharmacoepidemiology and Pharmacoeconomics, Harvard Medical/Brigham & Women's Hospital, Boston, Massachusetts, USA.
authors.forename: S V
authors.initials: SV
authors.lastname: Wang
authors.affiliation: Corporate Department Global Epidemiology, Boehringer Ingelheim, Ingelheim, Germany.
authors.forename: P
authors.initials: P
authors.lastname: Verpillat
authors.affiliation: Aetion, Inc., New York, New York, USA.
authors.forename: J A
authors.initials: JA
authors.lastname: Rassen
authors.affiliation: Aetion, Inc., New York, New York, USA.
authors.forename: A
authors.initials: A
authors.lastname: Patrick
authors.affiliation: Department of Epidemiology, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA.
authors.forename: E M
authors.initials: EM
authors.lastname: Garry
authors.affiliation: Corporate Department Global Epidemiology, Boehringer Ingelheim, Ingelheim, Germany.|Hannover Medical School, Hannover, Germany.
authors.forename: D B
authors.initials: DB
authors.lastname: Bartels
mesh_terms: D022126:Access to Information; D015331:Cohort Studies; D016208:Databases, Factual; D006801:Humans; D064887:Observational Studies as Topic / Q000592:standards*; D017891:Pharmacoepidemiology / Q000592:standards*; D015203:Reproducibility of Results