A warning threshold for monitoring tuberculosis surveillance data: an alternative to hidden Markov model.
OBJECTIVE
Although hidden Markov model (HMM) is known as a powerful tool for the detection of epidemics based on the historical data, the frequent use of such a model poses some limitation especially when decision-making is required for new observations. This study was aimed to address a warning threshold for monitoring the weekly incidences of tuberculosis as an alternative to HMM.


METHODS
We extracted the weekly counts of newly diagnosed patients with sputum smear-positive pulmonary TB from 2005 to 2011 nationwide. To detect unexpected incidences of the disease, two approaches: Serfling and HMM, were applied in presence/absence of linear, seasonal and autoregressive components. Models were subsequently evaluated in terms of goodness of fit, and their results were compared in detection of the disease phases. Then, multiple hypothetical thresholds were constructed based on the estimate of models and the optimal one was revealed through ROC curve analysis.


RESULTS
Findings from both adjusted R-square (R~2) and Bayesian information criterion (BIC) presented a higher goodness of fit for periodic autoregressive HMM (BIC = -1323.6; R~2=0.74) than other models. According to ROC analysis, better values for both Youden's index and area under curve (0. 96 and 0. 98 respectively) were obtained by the threshold based on the estimate of periodic autoregressive model.


CONCLUSIONS
As the optimal threshold presented in this study is simple in concept and has no limitation in practice, especially for monitoring new observations, we would recommend such a threshold to be used for monitoring of TB incidence data in the surveillance system.
Ministry of Health and Medical Education, Tehran, Iran.
Ali
A
Rafei
Kharazmi University, Tehran, Iran.
Einollah
E
Pasha
Iran University of Medical Sciences, Tehran, Iran.
Roohangiz
R
Jamshidi Orak
D000465:Algorithms; D019540:Area Under Curve; D001499:Bayes Theorem; D003141:Communicable Diseases / Q000453:epidemiology; D004196:Disease Outbreaks; D058872:Epidemics; D006801:Humans; D015994:Incidence; D008390:Markov Chains; D008954:Models, Biological; D015233:Models, Statistical; D011159:Population Surveillance / Q000379:methods*; D012372:ROC Curve; D014397:Tuberculosis, Pulmonary / Q000453:epidemiology*
Modelo Oculto de Markov; Tuberculosis; Umbral de alerta; detección de epidemias; diseases surveillance; détection d’épidémie; epidemic detection; hidden Markov model; modèle de Hidden Markov; seuil d'alerte; surveillance des maladies; tuberculose; tuberculosis; vigilancia de enfermedades; warning threshold