title: Multimodal acquisition of articulatory data: Geometrical and temporal registration.
abstract: Acquisition of dynamic articulatory data is of major importance for studying speech production. It turns out that one technique alone often is not enough to get a correct coverage of the whole vocal tract at a sufficient sampling rate. Ultrasound (US) imaging has been proposed as a good acquisition technique for the tongue surface because it offers a good temporal sampling, does not alter speech production, is cheap, and is widely available. However, it cannot be used alone and this paper describes a multimodal acquisition system which uses electromagnetography sensors to locate the US probe. The paper particularly focuses on the calibration of the US modality which is the key point of the system. This approach enables US data to be merged with other data. The use of the system is illustrated via an experiment consisting of measuring the minimal tongue to palate distance in order to evaluate and design Magnetic Resonance Imaging protocols well suited for the acquisition of three-dimensional images of the vocal tract. Compared to manual registration of acquisition modalities which is often used in acquisition of articulatory data, the approach presented relies on automatic techniques well founded from geometrical and mathematical points of view.
authors.affiliation: Institut Supérieur de l'Electronique et du Numérique, Brest, France.
authors.forename: Michaël
authors.initials: M
authors.lastname: Aron
authors.affiliation: Institut de Recherche en Informatique et en Automatique, Centre National de la Recherche Scientifique, Université de Lorraine, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Vandœuvre-lès-Nancy, France.
authors.forename: Marie-Odile
authors.initials: MO
authors.lastname: Berger
authors.affiliation: Institut de Recherche en Informatique et en Automatique, Centre National de la Recherche Scientifique, Université de Lorraine, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Vandœuvre-lès-Nancy, France.
authors.forename: Erwan
authors.initials: E
authors.lastname: Kerrien
authors.affiliation: Institut de Recherche en Informatique et en Automatique, Centre National de la Recherche Scientifique, Université de Lorraine, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Vandœuvre-lès-Nancy, France.
authors.forename: Brigitte
authors.initials: B
authors.lastname: Wrobel-Dautcourt
authors.affiliation: Institut de Recherche en Informatique et en Automatique, Centre National de la Recherche Scientifique, Université de Lorraine, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Vandœuvre-lès-Nancy, France.
authors.forename: Blaise
authors.initials: B
authors.lastname: Potard
authors.affiliation: Institut de Recherche en Informatique et en Automatique, Centre National de la Recherche Scientifique, Université de Lorraine, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Vandœuvre-lès-Nancy, France.
authors.forename: Yves
authors.initials: Y
authors.lastname: Laprie
mesh_terms: D000162:Acoustics / Q000295:instrumentation; D001331:Automation; D001696:Biomechanical Phenomena; D002138:Calibration; D055590:Electromagnetic Phenomena; D006801:Humans; D007091:Image Processing, Computer-Assisted; D021621:Imaging, Three-Dimensional; D007830:Larynx / Q000000981:diagnostic imaging*; D008279:Magnetic Resonance Imaging; D064847:Multimodal Imaging; D010699:Phonation; D012815:Signal Processing, Computer-Assisted; D013061:Speech Acoustics; D013068:Speech Production Measurement / Q000295:instrumentation / Q000379:methods* / Q000592:standards; D013997:Time Factors; D014059:Tongue / Q000000981:diagnostic imaging*; D014159:Transducers; D014463:Ultrasonography / Q000295:instrumentation / Q000379:methods* / Q000592:standards; D014833:Voice Quality