title: Multisensor data fusion for enhanced respiratory rate estimation in thermal videos.
abstract: Scientific studies have demonstrated that an atypical respiratory rate (RR) is frequently one of the earliest and major indicators of physiological distress. However, it is also described in the literature as "the neglected vital parameter", mainly due to shortcomings of clinical available monitoring techniques, which require attachment of sensors to the patient's body. The current paper introduces a novel approach that uses multisensor data fusion for an enhanced RR estimation in thermal videos. It considers not only the temperature variation around nostrils and mouth, but the upward and downward movement of both shoulders. In order to analyze the performance of our approach, two experiments were carried out on five healthy candidates. While during phase A, the subjects breathed normally, during phase B they simulated different breathing patterns. Thoracic effort was the gold standard elected to validate our algorithm. Our results show an excellent agreement between infrared thermography (IRT) and ground truth. While in phase A a mean correlation of 0.983 and a root-mean-square error of 0.240 bpm (breaths per minute) was obtained, in phase B they hovered around 0.995 and 0.890 bpm, respectively. In sum, IRT may be a promising clinical alternative to conventional sensors. Additionally, multisensor data fusion contributes to an enhancement of RR estimation and robustness.
authors.forename: Carina B
authors.initials: CB
authors.lastname: Pereira
authors.lastname: Xinchi Yu
authors.forename: Vladimir
authors.initials: V
authors.lastname: Blazek
authors.forename: Boudewijn
authors.initials: B
authors.lastname: Venema
authors.forename: Steffen
authors.initials: S
authors.lastname: Leonhardt
mesh_terms: D000328:Adult; D000465:Algorithms; D005260:Female; D006358:Hot Temperature; D006801:Humans; D008297:Male; D009068:Movement; D012119:Respiration; D056152:Respiratory Rate / Q000502:physiology*; D012815:Signal Processing, Computer-Assisted; D014743:Videotape Recording