title: Evaluation of prompted annotation of activity data recorded from a smart phone.
abstract: In this paper we discuss the design and evaluation of a mobile based tool to collect activity data on a large scale. The current approach, based on an existing activity recognition module, recognizes class transitions from a set of specific activities (for example walking and running) to the standing still activity. Once this transition is detected the system prompts the user to provide a label for their previous activity. This label, along with the raw sensor data, is then stored locally prior to being uploaded to cloud storage. The system was evaluated by ten users. Three evaluation protocols were used, including a structured, semi-structured and free living protocol. Results indicate that the mobile application could be used to allow the user to provide accurate ground truth labels for their activity data. Similarities of up to 100% where observed when comparing the user prompted labels and those from an observer during structured lab based experiments. Further work will examine data segmentation and personalization issues in order to refine the system.
authors.affiliation: School of Computing and Mathematics, Computer Science Research Institute, University of Ulster, Newtownabbey, Co. Antrim, BT38 0QB, Northern Ireland, UK. i.cleland@ulster.ac.uk.
authors.forename: Ian
authors.initials: I
authors.lastname: Cleland
authors.affiliation: Ubiquitous Computing Laboratory, Kyung Hee University, 1 Seocheon-dong, Giheung-gu, Yongin-si, Gyeonggi-do 446-701, Korea. smiley@oslab.khu.ac.kr.
authors.forename: Manhyung
authors.initials: M
authors.lastname: Han
authors.affiliation: School of Computing and Mathematics, Computer Science Research Institute, University of Ulster, Newtownabbey, Co. Antrim, BT38 0QB, Northern Ireland, UK. cd.nugent@ulster.ac.uk.
authors.forename: Chris
authors.initials: C
authors.lastname: Nugent
authors.affiliation: Ubiquitous Computing Laboratory, Kyung Hee University, 1 Seocheon-dong, Giheung-gu, Yongin-si, Gyeonggi-do 446-701, Korea. hslee@oslab.khu.ac.kr.
authors.forename: Hosung
authors.initials: H
authors.lastname: Lee
authors.affiliation: School of Computing and Information Engineering, University of Ulster, Coleraine, Co. Londonderry, BT52 1SA, UK. si.mcclean@ulster.ac.uk.
authors.forename: Sally
authors.initials: S
authors.lastname: McClean
authors.affiliation: School of Computing and Mathematics, Computer Science Research Institute, University of Ulster, Newtownabbey, Co. Antrim, BT38 0QB, Northern Ireland, UK. s.zhang@ulster.ac.uk.
authors.forename: Shuai
authors.initials: S
authors.lastname: Zhang
authors.affiliation: Ubiquitous Computing Laboratory, Kyung Hee University, 1 Seocheon-dong, Giheung-gu, Yongin-si, Gyeonggi-do 446-701, Korea. sylee@oslab.khu.ac.kr.
authors.forename: Sungyoung
authors.initials: S
authors.lastname: Lee