Design issues for socially intelligent user interfaces. A discourse analysis of a data-to-text system for summarizing clinical data.
OBJECTIVE
This study aims to demonstrate the usability of discourse analyses as a means of evaluating medical informatics systems by examining one particular computer-based data-to-text system for delivering neonatal health care information.


METHODS
Six textual summaries of clinical information, three produced by human clinicians and three by the data-to-text system, were subjected to fine-grain discourse analysis. Analysis was performed 'blind' on all six textual summaries. Analysis focused on the identification of lexical items and on the potential effects of these items on users of these clinical information summaries.


RESULTS
Results showed that there were clear differences between human- and system-generated clinical summaries, with human clinicians providing better narrative flow and textual detail. The data-to-text system successfully produced textual summaries although it fell short of human abilities.


CONCLUSIONS
These results indicate potential future improvements to the system. Discourse analysis as used here may offer significant advantages in evaluating and developing similar medical informatics systems.
McKinlay
A
A
Department of Psychology, 7 George Square, University of Edinburgh, Edinburgh, EH8 9JZ, United Kingdom. a.mckinlay@ed.ac.uk
McVittie
C
C
Reiter
E
E
Freer
Y
Y
Sykes
C
C
Logie
R
R
D001185:Artificial Intelligence; D006801:Humans; D007231:Infant, Newborn; D007398:Interpersonal Relations; D008491:Medical Informatics Applications; D016347:Medical Records Systems, Computerized; D033262:Narration; D036301:Qualitative Research; D014584:User-Computer Interface