title: Fusing Continuous-Valued Medical Labels Using a Bayesian Model.
abstract: With the rapid increase in volume of time series medical data available through wearable devices, there is a need to employ automated algorithms to label data. Examples of labels include interventions, changes in activity (e.g. sleep) and changes in physiology (e.g. arrhythmias). However, automated algorithms tend to be unreliable resulting in lower quality care. Expert annotations are scarce, expensive, and prone to significant inter- and intra-observer variance. To address these problems, a Bayesian Continuous-valued Label Aggregator (BCLA) is proposed to provide a reliable estimation of label aggregation while accurately infer the precision and bias of each algorithm. The BCLA was applied to QT interval (pro-arrhythmic indicator) estimation from the electrocardiogram using labels from the 2006 PhysioNet/Computing in Cardiology Challenge database. It was compared to the mean, median, and a previously proposed Expectation Maximization (EM) label aggregation approaches. While accurately predicting each labelling algorithm's bias and precision, the root-mean-square error of the BCLA was 11.78 ± 0.63 ms, significantly outperforming the best Challenge entry (15.37 ± 2.13 ms) as well as the EM, mean, and median voting strategies (14.76 ± 0.52, 17.61 ± 0.55, and 14.43 ± 0.57 ms respectively with p < 0.0001). The BCLA could therefore provide accurate estimation for medical continuous-valued label tasks in an unsupervised manner even when the ground truth is not available.
authors.affiliation: Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, UK. tingting.zhu@eng.ox.ac.uk.
authors.forename: Tingting
authors.initials: T
authors.lastname: Zhu
authors.affiliation: Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, UK.
authors.forename: Nic
authors.initials: N
authors.lastname: Dunkley
authors.affiliation: Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, UK.
authors.forename: Joachim
authors.initials: J
authors.lastname: Behar
authors.affiliation: Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, UK.
authors.forename: David A
authors.initials: DA
authors.lastname: Clifton
authors.affiliation: Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, UK.|Departments of Biomedical Informatics, Emory University, Atlanta, GA, USA.|Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
authors.forename: Gari D
authors.initials: GD
authors.lastname: Clifford
mesh_terms: D000465:Algorithms; D001499:Bayes Theorem; D016208:Databases, Factual; D004562:Electrocardiography; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D015233:Models, Statistical
keywords: Bayes methods; Crowdsourcing; Electrocardiography; Time series analysis