title: Evaluation of Fear Using Nonintrusive Measurement of Multimodal Sensors.
abstract: Most previous research into emotion recognition used either a single modality or multiple modalities of physiological signal. However, the former method allows for limited enhancement of accuracy, and the latter has the disadvantages that its performance can be affected by head or body movements. Further, the latter causes inconvenience to the user due to the sensors attached to the body. Among various emotions, the accurate evaluation of fear is crucial in many applications, such as criminal psychology, intelligent surveillance systems and the objective evaluation of horror movies. Therefore, we propose a new method for evaluating fear based on nonintrusive measurements obtained using multiple sensors. Experimental results based on the t-test, the effect size and the sum of all of the correlation values with other modalities showed that facial temperature and subjective evaluation are more reliable than electroencephalogram (EEG) and eye blinking rate for the evaluation of fear.
authors.affiliation: Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea. jjongssuk@dgu.edu.
authors.forename: Jong-Suk
authors.initials: JS
authors.lastname: Choi
authors.affiliation: Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea. bangjw@dgu.edu.
authors.forename: Jae Won
authors.initials: JW
authors.lastname: Bang
authors.affiliation: Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea. gjghks@dgu.edu.
authors.forename: Hwan
authors.initials: H
authors.lastname: Heo
authors.affiliation: Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea. parkgr@dongguk.edu.
authors.forename: Kang Ryoung
authors.initials: KR
authors.lastname: Park
mesh_terms: D000328:Adult; D001767:Blinking; D001831:Body Temperature; D004566:Electrodes; D004569:Electroencephalography / Q000295:instrumentation* / Q000379:methods*; D005145:Face; D005239:Fear / Q000502:physiology*; D005260:Female; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008297:Male; D011680:Pupil / Q000502:physiology; D011795:Surveys and Questionnaires; D014741:Video Recording
keywords: facial temperature; fear; nonintrusive multimodal measurement; subjective evaluation