A martingale framework for detecting changes in data streams by testing exchangeability.
In a data streaming setting, data points are observed sequentially. The data generating model may change as the data are streaming. In this paper, we propose detecting this change in data streams by testing the exchangeability property of the observed data. Our martingale approach is an efficient, nonparametric, one-pass algorithm that is effective on the classification, cluster, and regression data generating models. Experimental results show the feasibility and effectiveness of the martingale methodology in detecting changes in the data generating model for time-varying data streams. Moreover, we also show that: 1) An adaptive support vector machine (SVM) utilizing the martingale methodology compares favorably against an adaptive SVM utilizing a sliding window, and 2) a multiple martingale video-shot change detector compares favorably against standard shot-change detection algorithms.
Center for Automated Research, University of Maryland Institute for Advanced Computer Studies, A.V. Williams Building, College Park, MD 20742, USA. hoshensh@umd.edu
Shen-Shyang
SS
Ho
Harry
H
Wechsler