Key design elements of a data utility for national biosurveillance: event-driven architecture, caching, and Web service model.
The National Retail Data Monitor (NRDM) has monitored over-the-counter (OTC) medication sales in the United States since December 2002. The NRDM collects data from over 18,600 retail stores and processes over 0.6 million sales records per day. This paper describes key architectural features that we have found necessary for a data utility component in a national biosurveillance system. These elements include event-driven architecture to provide analyses of data in near real time, multiple levels of caching to improve query response time, high availability through the use of clustered servers, scalable data storage through the use of storage area networks and a web-service function for interoperation with affiliated systems. The methods and architectural principles are relevant to the design of any production data utility for public health surveillance-systems that collect data from multiple sources in near real time for use by analytic programs and user interfaces that have substantial requirements for time-series data aggregated in multiple dimensions.
Tsui
Fu-Chiang
FC
RODS Laboratory, Center of Biomedical Informatics, University of Pittsburgh, PA 15219, USA.
Espino
Jeremy U
JU
Weng
Yan
Y
Choudary
Arvinder
A
Su
Hoah-Der
HD
Wagner
Michael M
MM
D003132:Commerce / Q000706:statistics & numerical data*; D003199:Computer Systems; D016208:Databases, Factual; D004196:Disease Outbreaks / Q000706:statistics & numerical data*; D006801:Humans; D020407:Internet; D004366:Nonprescription Drugs; D011159:Population Surveillance / Q000379:methods*; D040442:Public Health Informatics; D012984:Software; D014481:United States; D014584:User-Computer Interface
D004366:Nonprescription Drugs