title: Metrics for assessing the reliability of a telemedicine remote monitoring system.
abstract: OBJECTIVE
  The goal of this study was to assess using new metrics the reliability of a real-time health monitoring system in homes of older adults.
  
  
  METHODS
  The "MobileCare Monitor" system was installed into the homes of nine older adults >75 years of age for a 2-week period. The system consisted of a wireless wristwatch-based monitoring system containing sensors for location, temperature, and impacts and a "panic" button that was connected through a mesh network to third-party wireless devices (blood pressure cuff, pulse oximeter, weight scale, and a survey-administering device). To assess system reliability, daily phone calls instructed participants to conduct system tests and reminded them to fill out surveys and daily diaries. Phone reports and participant diary entries were checked against data received at a secure server.
  
  
  RESULTS
  Reliability metrics assessed overall system reliability, data concurrence, study effectiveness, and system usability. Except for the pulse oximeter, system reliability metrics varied between 73% and 92%. Data concurrence for proximal and distal readings exceeded 88%. System usability following the pulse oximeter firmware update varied between 82% and 97%. An estimate of watch-wearing adherence within the home was quite high, about 80%, although given the inability to assess watch-wearing when a participant left the house, adherence likely exceeded the 10 h/day requested time. In total, 3,436 of 3,906 potential measurements were obtained, indicating a study effectiveness of 88%.
  
  
  CONCLUSIONS
  The system was quite effective in providing accurate remote health data. The different system reliability measures identify important error sources in remote monitoring systems.
authors.affiliation: Department of Psychology, Florida State University, Tallahassee, Florida 32306-4301, USA. charness@psy.fsu.edu
authors.forename: Neil
authors.initials: N
authors.lastname: Charness
authors.forename: Mark
authors.initials: M
authors.lastname: Fox
authors.forename: Amy
authors.initials: A
authors.lastname: Papadopoulos
authors.forename: Cindy
authors.initials: C
authors.lastname: Crump
mesh_terms: D000368:Aged; D005431:Florida; D006801:Humans; D058998:Remote Sensing Technology / Q000295:instrumentation*; D015203:Reproducibility of Results; D017216:Telemedicine