title: Multiband analysis and synthesis of spectro-temporal modulations of Fourier spectrogram.
abstract: The two-dimensional spectro-temporal modulation filtering concept of the auditory model [T. Chi, P. Ru, and S. A. Shamma, J. Acoust. Soc. Am. 118(2), 887-906 (2005)] is implemented on the Fourier spectrogram. The Fourier magnitude spectrogram is analyzed in terms of its joint spectro-temporal modulations, which embed the temporal dynamics and spectral structures. Instead of iterative projection methods, the overlap-and-add method is adopted to invert modified Fourier spectrograms back to sounds. The proposed framework not only provides a similar spectro-temporal analytical process for sounds as the auditory model but also produces synthesized sounds with better quality in a timely manner, which makes proposed framework feasible to human speech recognition (HSR) applications as well.
authors.affiliation: Department of Electrical Engineering, National Chiao Tung University, Hsinchu 300, Taiwan. tschi@mail.nctu.edu.tw
authors.forename: Tai-Shih
authors.initials: TS
authors.lastname: Chi
authors.forename: Chung-Chien
authors.initials: CC
authors.lastname: Hsu
mesh_terms: D000465:Algorithms; D001303:Auditory Cortex / Q000502:physiology; D003143:Communication Devices for People with Disabilities; D005260:Female; D005583:Fourier Analysis; D006801:Humans; D008297:Male; D008959:Models, Neurological; D010700:Phonetics; D011984:Sensory Receptor Cells / Q000502:physiology; D013018:Sound Spectrography / Q000379:methods* / Q000706:statistics & numerical data; D013065:Speech Intelligibility; D049250:Speech Recognition Software