Multisite Evaluation of a Data Quality Tool for Patient-Level Clinical Data Sets.
BACKGROUND
Data quality and fitness for analysis are crucial if outputs of analyses of electronic health record data or administrative claims data should be trusted by the public and the research community.


METHODS
We describe a data quality analysis tool (called Achilles Heel) developed by the Observational Health Data Sciences and Informatics Collaborative (OHDSI) and compare outputs from this tool as it was applied to 24 large healthcare datasets across seven different organizations.


RESULTS
We highlight 12 data quality rules that identified issues in at least 10 of the 24 datasets and provide a full set of 71 rules identified in at least one dataset. Achilles Heel is a freely available software that provides a useful starter set of data quality rules with the ability to add additional rules. We also present results of a structured email-based interview of all participating sites that collected qualitative comments about the value of Achilles Heel for data quality evaluation.


CONCLUSIONS
Our analysis represents the first comparison of outputs from a data quality tool that implements a fixed (but extensible) set of data quality rules. Thanks to a common data model, we were able to compare quickly multiple datasets originating from several countries in America, Europe and Asia.
National Institute of Health; National Library of Medicine.
Vojtech
V
Huser
Janssen Research & Development.
Frank J
FJ
DeFalco
Janssen Research & Development; Observational Health Data Sciences and Informatics.
Martijn
M
Schuemie
Janssen Research & Development.
Patrick B
PB
Ryan
Department of Biomedical Informatics, Columbia University.
Ning
N
Shang
Department of Biomedical Informatics, Columbia University.
Mark
M
Velez
Department of Biomedical Informatics, Ajou University.
Rae Woong
RW
Park
Department of Biomedical Informatics, University of Pittsburgh.
Richard D
RD
Boyce
Regenstrief Institute.
Jon
J
Duke
Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia.
Ritu
R
Khare
Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia.
Levon
L
Utidjian
Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia.
Charles
C
Bailey
Common Data Model; Data Use and Quality; Electronic Health Record (EHR); Informatics