Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.
BACKGROUND
Postmarketing surveillance is routinely conducted to monitor performance of pharmaceuticals and testing devices in the marketplace. However, these surveillance methods are often done retrospectively and, as a result, are not designed to detect issues with performance in real-time.


RESULTS
Using HIV antibody screening test data from New York City STD clinics, we developed a formal, statistical method of prospectively detecting temporal clusters of poor performance of a screening test. From 2005 to 2008, New York City, as well as other states, observed unexpectedly high false-positive (FP) rates in an oral fluid-based rapid test used for screening HIV. We attempted to formally assess whether the performance of this HIV screening test statistically deviated from both local expectation and the manufacturer's claim for the test. Results indicate that there were two significant temporal clusters in the FP rate of the oral HIV test, both of which exceeded the manufacturer's upper limit of the 95% CI for the product. Furthermore, the FP rate of the test varied significantly by both STD clinic and test lot, though not by test operator.


CONCLUSIONS
Continuous monitoring of surveillance data has the benefit of providing information regarding test performance, and if conducted in real-time, it can enable programs to examine reasons for poor test performance in close proximity to the occurrence. Techniques used in this study could be a valuable addition for postmarketing surveillance of test performance and may become particularly important with the increase in rapid testing methods.
Egger
Joseph R
JR
Department of Health and Mental Hygiene,Bureau of Epidemiology Services, New York City, New York, New York, United States of America. jegger@health.nyc.gov
Konty
Kevin J
KJ
Borrelli
Jessica M
JM
Cummiskey
Julia
J
Blank
Susan
S
D001826:Body Fluids / Q000821:virology*; D005189:False Positive Reactions; D006678:HIV / Q000302:isolation & purification*; D008403:Mass Screening / Q000295:instrumentation / Q000379:methods* / Q000592:standards; D009055:Mouth; D011358:Product Surveillance, Postmarketing / Q000379:methods*; D011446:Prospective Studies; D011786:Quality Control; D012680:Sensitivity and Specificity; D012749:Sexually Transmitted Diseases; D013997:Time Factors
AIDS. 2006 Aug 1;20(12):1661-6
16868448
J Clin Microbiol. 1999 Mar;37(3):721-3
9986839
Health Aff (Millwood). 2005 Jul-Aug;24(4):938-48
16012136
N Engl J Med. 1994 Dec 1;331(22):1493-9
7969300
MMWR Morb Mortal Wkly Rep. 2009 Aug 7;58(30):826-9
19661856
MMWR Morb Mortal Wkly Rep. 2008 Jun 20;57(24):660-5
18566566
PLoS One. 2007 Jan 31;2(1):e185
17268576
MMWR Suppl. 2004 Sep 24;53:5-11
15714620
Emerg Infect Dis. 2004 May;10(5):858-64
15200820