title: Combined Auditory and Vibrotactile Feedback for Human-Machine-Interface Control.
abstract: The purpose of this study was to determine the effect of the addition of binary vibrotactile stimulation to continuous auditory feedback (vowel synthesis) for human-machine interface (HMI) control. Sixteen healthy participants controlled facial surface electromyography to achieve 2-D targets (vowels). Eight participants used only real-time auditory feedback to locate targets whereas the other eight participants were additionally alerted to having achieved targets with confirmatory vibrotactile stimulation at the index finger. All participants trained using their assigned feedback modality (auditory alone or combined auditory and vibrotactile) over three sessions on three days and completed a fourth session on the third day using novel targets to assess generalization. Analyses of variance performed on the 1) percentage of targets reached and 2) percentage of trial time at the target revealed a main effect for feedback modality: participants using combined auditory and vibrotactile feedback performed significantly better than those using auditory feedback alone. No effect was found for session or the interaction of feedback modality and session, indicating a successful generalization to novel targets but lack of improvement over training sessions. Future research is necessary to determine the cognitive cost associated with combined auditory and vibrotactile feedback during HMI control.
authors.forename: Elias B
authors.initials: EB
authors.lastname: Thorp
authors.forename: Eric
authors.initials: E
authors.lastname: Larson
authors.forename: Cara E
authors.initials: CE
authors.lastname: Stepp
mesh_terms: D001307:Auditory Perception / Q000502:physiology*; D001676:Biofeedback, Psychology / Q000379:methods / Q000502:physiology; D004576:Electromyography / Q000379:methods*; D005152:Facial Muscles / Q000502:physiology*; D056228:Feedback, Sensory / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D008328:Man-Machine Systems; D012016:Reference Values; D013647:Task Performance and Analysis; D014110:Touch / Q000502:physiology*; D014732:Vibration; D055815:Young Adult
references.citation: Psychophysiology. 2009 May;46(3):617-25
references.pmid: 19170946
references.citation: J Mot Behav. 2007 May;39(3):179-93
references.pmid: 17550870
references.citation: PLoS One. 2009 Dec 09;4(12):e8218
references.pmid: 20011034
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2006 Jun;14(2):229-33
references.pmid: 16792301
references.citation: Nature. 1999 Mar 25;398(6725):297-8
references.pmid: 10192330
references.citation: Annu Int Conf IEEE Eng Med Biol Soc. 2011;2011:4576-9
references.pmid: 22255356
references.citation: PLoS One. 2010 Apr 01;5(4):e9813
references.pmid: 20368976
references.citation: Proc Natl Acad Sci U S A. 2004 Dec 21;101(51):17849-54
references.pmid: 15585584
references.citation: Neurorehabil Neural Repair. 2005 Sep;19(3):206-18
references.pmid: 16093411
references.citation: Clin Neurophysiol. 2008 Aug;119(8):1909-1916
references.pmid: 18571984
references.citation: J Neural Eng. 2012 Jun;9(3):036013
references.pmid: 22626956
references.citation: IEEE Trans Rehabil Eng. 2000 Jun;8(2):190-3
references.pmid: 10896183
references.citation: J Acoust Soc Am. 1995 Jan;97(1):553-62
references.pmid: 7860832
references.citation: J Speech Lang Hear Res. 2012 Aug;55(4):1232-46
references.pmid: 22232412
references.citation: J Neural Eng. 2012 Aug;9(4):045002
references.pmid: 22831906
references.citation: Comput Intell Neurosci. 2007;:48937
references.pmid: 18354734
references.citation: PLoS One. 2012;7(2):e32743
references.pmid: 22384283
references.citation: Exp Brain Res. 2012 Aug;221(1):33-41
references.pmid: 22733310
references.citation: Ergonomics. 2003 Jan 15;46(1-3):68-87
references.pmid: 12554399
references.citation: IEEE Trans Biomed Eng. 1991 Jan;38(1):1-16
references.pmid: 2026426
references.citation: Clin Neurophysiol. 2002 Jun;113(6):767-91
references.pmid: 12048038
references.citation: J Neurosci. 2010 Dec 15;30(50):16777-87
references.pmid: 21159949
references.citation: J Neuroeng Rehabil. 2012 Oct 10;9:79
references.pmid: 23046683
references.citation: Clin Neurophysiol. 2003 Mar;114(3):416-25
references.pmid: 12705422
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2011 Dec;19(6):677-85
references.pmid: 21984521
references.citation: J Neurosci Methods. 2008 Jan 15;167(1):43-50
references.pmid: 17399797
references.citation: J Neural Eng. 2008 Mar;5(1):75-84
references.pmid: 18310813
references.citation: Front Neurosci. 2010 May 06;4:19
references.pmid: 20582261
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2006 Jun;14(2):147-52
references.pmid: 16792281
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2006 Mar;14(1):30-7
references.pmid: 16562629
references.citation: Clin Neurophysiol. 2006 Mar;117(3):538-48
references.pmid: 16461003
references.citation: J Neural Eng. 2012 Aug;9(4):045005
references.pmid: 22831989
references.citation: J Neuroeng Rehabil. 2007 Oct 17;4:40
references.pmid: 17941986
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2011 Apr;19(2):193-203
references.pmid: 21278024
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2006 Jun;14(2):225-9
references.pmid: 16792300
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2012 Jan;20(1):31-7
references.pmid: 21997322
references.citation: PLoS One. 2013;8(3):e59860
references.pmid: 23527278
references.citation: IEEE Trans Biomed Eng. 2012 Feb;59(2):400-8
references.pmid: 22042125