title: Usability, learnability and performance evaluation of Intelligent Research and Intervention Software: A delivery platform for eHealth interventions.
abstract: Evaluation of an eHealth platform, Intelligent Research and Intervention Software was undertaken via cross-sectional survey of staff users and application performance monitoring. The platform is used to deliver psychosocial interventions across a range of clinical contexts, project scopes, and delivery modalities (e.g. hybrid telehealth, fully online self-managed, randomized control trials, and clinical service delivery). Intelligent Research and Intervention Software supports persuasive technology elements (e.g. tailoring, reminders, and personalization) as well as staff management tools. Results from the System Usability Scale involving 30 Staff and Administrative users across multiple projects were positive with overall mean score of 70 ("Acceptable"). The mean score for "Usability" sub-scale was 82 and for "Learnability" sub-scale 61. There were no significant differences in perceptions of usability across user groups or levels of experience. Application performance management analytics (e.g. Application Performance Index scores) across two test sites indicate the software platform is robust and reliable when compared to industry standards. Intelligent Research and Intervention Software is successfully operating as a flexible platform for creating, delivering, and evaluating eHealth interventions.
authors.affiliation: IWK Health Centre, Canada lori.wozney@iwk.nshealth.ca.
authors.forename: Lori
authors.initials: L
authors.lastname: Wozney
authors.affiliation: IWK Health Centre, Canada; Dalhousie University, Canada.
authors.forename: Patrick J
authors.initials: PJ
authors.lastname: McGrath
authors.affiliation: University of Alberta, Canada.
authors.forename: Amanda
authors.initials: A
authors.lastname: Newton
authors.affiliation: IWK Health Centre, Canada; Dalhousie University, Canada.
authors.forename: Anna
authors.initials: A
authors.lastname: Huguet
authors.forename: Marcia
authors.initials: M
authors.lastname: Franklin
authors.forename: Kaitlin
authors.initials: K
authors.lastname: Perri
authors.forename: K
authors.initials: K
authors.lastname: Leuschen
authors.affiliation: IWK Health Centre, Canada.
authors.forename: Elaine
authors.initials: E
authors.lastname: Toombs
authors.affiliation: Dalhousie University, Canada.
authors.forename: Patricia
authors.initials: P
authors.lastname: Lingley-Pottie
mesh_terms: D003430:Cross-Sectional Studies; D006801:Humans; D007858:Learning; D000073278:Self-Management; D012984:Software; D017216:Telemedicine / Q000379:methods* / Q000592:standards; D014584:User-Computer Interface
keywords: eHealth; intervention studies; telehealth; usability; user experience