Effects of speech- and text-based interaction modes in natural language human-computer dialogue.
OBJECTIVE
This study examined the effects of user production (speaking and typing) and user reception (listening and reading) modes on natural language human-computer dialogue.


BACKGROUND
Text-based dialogue is often more efficient than speech-based dialogue, but the latter is more dynamic and more suitable for mobile environments and hands-busy situations. The respective contributions of user production and reception modes have not previously been assessed.


METHODS
Eighteen participants performed several information search tasks using a natural language information system in four experimental conditions: phone (speaking and listening), Web (typing and reading), and mixed (speaking and reading or typing and listening).


RESULTS
Mental workload was greater and participants' repetitions of commands were more frequent when speech (speaking or listening) was used for both the user production and reception modes rather than text (typing or reading). Completion times were longer for listening than for reading. Satisfaction was lower, utterances were longer, and the interaction error rate was higher for speaking than typing.


CONCLUSIONS
The production and reception modes both contribute to dialogue and mental workload. They have distinct contributions to performance, satisfaction, and the form of the discourse.


CONCLUSIONS
The most efficient configuration for interacting in natural language would appear to be speech for production and system prompts in text, as this combination decreases the time on task while improving dialogue involvement.
Le Bigot
Ludovic
L
Poitiers University, France. ludovic.le.bigot@univ-poitiers.fr
Rouet
Jean-François
JF
Jamet
Eric
E
D000328:Adult; D004526:Efficiency; D005260:Female; D005602:France; D006801:Humans; D008297:Male; D008875:Middle Aged; D009323:Natural Language Processing; D011795:Surveys and Questionnaires; D013647:Task Performance and Analysis; D014584:User-Computer Interface; D014956:Writing