title: Usability testing of a respiratory interface using computer screen and facial expressions videos.
abstract: Computer screen videos (CSVs) and users' facial expressions videos (FEVs) are recommended to evaluate systems performance. However, software combining both methods is often non-accessible in clinical research fields. The Observer-XT software is commonly used for clinical research to assess human behaviours. Thus, this study reports on the combination of CSVs and FEVs, to evaluate a graphical user interface (GUI). Eight physiotherapists entered clinical information in the GUI while CSVs and FEVs were collected. The frequency and duration of a list of behaviours found in FEVs were analysed using the Observer-XT-10.5. Simultaneously, the frequency and duration of usability problems of CSVs were manually registered. CSVs and FEVs timelines were also matched to verify combinations. The analysis of FEVs revealed that the category most frequently observed in users behaviour was the eye contact with the screen (ECS, 32±9) whilst verbal communication achieved the highest duration (14.8±6.9min). Regarding the CSVs, 64 problems, related with the interface (73%) and the user (27%), were found. In total, 135 usability problems were identified by combining both methods. The majority were reported through verbal communication (45.8%) and ECS (40.8%). "False alarms" and "misses" did not cause quantifiable reactions and the facial expressions problems were mainly related with the lack of familiarity (55.4%) felt by users when interacting with the interface. These findings encourage the use of Observer-XT-10.5 to conduct small usability sessions, as it identifies emergent groups of problems by combining methods. However, to validate final versions of systems further validation should be conducted using specialized software.
authors.affiliation: School of Health Sciences, University of Aveiro (ESSUA), Campus Universitário de Santiago, Edifício 30, Agras do Crasto - Campus Universitário de Santiago, 3810-193 Aveiro, Portugal. Electronic address: alao@ua.pt.
authors.forename: Ana
authors.initials: A
authors.lastname: Oliveira
authors.forename: Cátia
authors.initials: C
authors.lastname: Pinho
authors.forename: Sandra
authors.initials: S
authors.lastname: Monteiro
authors.forename: Ana
authors.initials: A
authors.lastname: Marcos
authors.forename: Alda
authors.initials: A
authors.lastname: Marques
mesh_terms: D005149:Facial Expression; D005260:Female; D006801:Humans; D008297:Male; D012119:Respiration; D014584:User-Computer Interface
keywords: Facial videos; Graphical user interface; Observer XT; Screen videos; Usability testing