title: Quantifying Engagement: Measuring Player Involvement in Human-Avatar Interactions.
abstract: This research investigated the merits of using an established system for rating behavioral cues of involvement in human dyadic interactions (i.e., face-to-face conversation) to measure involvement in human-avatar interactions. Gameplay audio-video and self-report data from a Feasibility Trial and Free Choice study of an effective peer resistance skill building simulation game (DRAMA-RAMA™) were used to evaluate reliability and validity of the rating system when applied to human-avatar interactions. The Free Choice study used a revised game prototype that was altered to be more engaging. Both studies involved girls enrolled in a public middle school in Central Florida that served a predominately Hispanic (greater than 80%), low-income student population. Audio-video data were coded by two raters, trained in the rating system. Self-report data were generated using measures of perceived realism, predictability and flow administered immediately after game play. Hypotheses for reliability and validity were supported: Reliability values mirrored those found in the human dyadic interaction literature. Validity was supported by factor analysis, significantly higher levels of involvement in Free Choice as compared to Feasibility Trial players, and correlations between involvement dimension sub scores and self-report measures. Results have implications for the science of both skill-training intervention research and game design.
authors.affiliation: College of Nursing, University of Central Florida, 12201 Research Parkway, Orlando, FL 32826, USA.
authors.forename: Anne E
authors.initials: AE
authors.lastname: Norris
authors.affiliation: Nicholson School of Communication, University of Central Florida, 12405 Aquarius Agora Dr., Orlando, FL 32816-1344.
authors.forename: Harry
authors.initials: H
authors.lastname: Weger
authors.affiliation: Department of English, College of Arts & Humanities, University of Central Florida, P.O. Box 161346, Orlando, FL 32816-1346.
authors.forename: Cory
authors.initials: C
authors.lastname: Bullinger
authors.affiliation: Nicholson School of Communication, University of Central Florida, 12405 Aquarius Agora Dr., Orlando, FL 32816-1344.
authors.forename: Alyssa
authors.initials: A
authors.lastname: Bowers
keywords: engagement; human-avatar interactions; involvement; simulation
references.citation: Commun Methods Meas. 2011 Jan 1;5(2):126-145
references.pmid: 21822459
references.citation: Nurs Res. 2013 Jan-Feb;62(1):25-35
references.pmid: 23150043
references.citation: Health Commun. 2013;28(7):657-70
references.pmid: 23980613
references.citation: J Pers. 1996 Jun;64(2):275-310
references.pmid: 8656320