Quality of data collection in a large HIV observational clinic database in sub-Saharan Africa: implications for clinical research and audit of care.
BACKGROUND
Observational HIV clinic databases are now widely used to answer key questions related to HIV care and treatment, but there has been no systematic evaluation of their quality of data. Our objective was to evaluate the completeness and accuracy of recording of key data HIV items in a large routine observational HIV clinic database.


METHODS
We looked at the number and rate of opportunistic infections (OIs) per 100 person years at risk in the 24 months following antiretroviral therapy (ART) initiation in 559 patients who initiated ART in 2004-2005 and enrolled into a research cohort. We compared this with data in a routine clinic database for the same 559 patients, and a further 1233 patients who initiated ART in the same period. The Research Cohort database was considered as the reference "gold standard" for the assessment of data accuracy. A crude percentage of underreporting of OIs in the clinic database was calculated based on the difference between the OI rates reported in both databases.We reviewed 100 clinic patient medical records to assess the accuracy of recording of key data items of OIs, ART toxicities and ART regimen changes.


RESULTS
The overall incidence rate per 100 person years at risk for the initial OI in the 559 patients in the research cohort and clinic databases was 24.1 (95% CI: 20.5-28.2) and 13.2 (95% CI: 10.8-16.2) respectively, and 10.4 (95% CI: 9.1-11.9) for the 1233 clinic patients. This represents a 1.8- and 2.3-fold higher rate of events in the research cohort database compared with the same 599 patients and 1233 patients in the routine clinic database, or a 45.1% and 56.8% rate of underreporting, respectively. The combined error rate of missing and incorrect items from the medical records' review was 67% for OIs, 52% for ART-related toxicities, and 83% and 58% for ART discontinuation and modification, respectively.


CONCLUSIONS
There is a high rate of underreporting of OIs in a routine HIV clinic database. This has important implications for the use and interpretation of routine observational databases for research and audit, and highlights the need for regular data validation of these databases.
Research department, Infectious Diseases Institute, Kampala, Uganda. akiragga@idi.co.ug
Agnes N
AN
Kiragga
Barbara
B
Castelnuovo
Petra
P
Schaefer
Timothy
T
Muwonge
Philippa J
PJ
Easterbrook
D000328:Adult; D017954:Africa South of the Sahara / Q000453:epidemiology; D019380:Anti-HIV Agents / Q000627:therapeutic use*; D035843:Biomedical Research / Q000592:standards*; D054869:Clinical Audit; D015331:Cohort Studies; D003625:Data Collection / Q000592:standards*; D016208:Databases, Factual / Q000592:standards*; D015658:HIV Infections / Q000188:drug therapy* / Q000453:epidemiology; D006801:Humans; D066298:In Vitro Techniques; D008297:Male
D019380:Anti-HIV Agents
J Clin Epidemiol. 2000 Apr;53(4):343-9
10785564
J Clin Epidemiol. 2000 Apr;53(4):377-83
10785568
J Clin Epidemiol. 2004 Dec;57(12):1295-304
15617956
HIV Med. 2004 Mar;5(2):115-24
15012652
Bull World Health Organ. 2008 Jul;86(7):559-67
18670668
J Acquir Immune Defic Syndr. 2007 Oct 1;46(2):187-93
17693883
Am J Epidemiol. 1987 Aug;126(2):310-8
3300281
Int J Epidemiol. 2005 Oct;34(5):979-86
16157617
HIV Med. 2003 Apr;4(2):87-93
12702128
Biometrics. 2009 Mar;65(1):301-6
18479488
JAMA. 2008 Aug 6;300(5):506-7
18677022
J Acquir Immune Defic Syndr. 2005 Feb 1;38(2):174-9
15671802
PLoS One. 2009 Jun 04;4(6):e5790
19495419
Arch Dis Child. 2004 Sep;89(9):856-9
15321866
AIDS. 1999 Oct 22;13(15):2075-82
10546860
Epidemiology. 1998 Mar;9(2):117-25
9504278