15th International Congress of Phonetic Sciences (ICPhS-15)

Barcelona, Spain
August 3-9, 2003

Resynthesis of Facial and Intraoral Articulation from Simultaneous Measurements

Jonas Beskow, Olov Engwall, Björn Granström

KTH, Sweden

Simultaneous measurements of tongue and facial motion, using a combination of electromagnetic articulography (EMA) and optical motion tracking, are analysed to improve the articulation of an animated talking head and to investigate the correlation between facial and vocal tract movement. The recorded material consists of VCV and CVC words and 270 short everyday sentences spoken by one Swedish subject. The recorded articulatory movements are re-synthesised by a parametrically controlled 3D model of the face and tongue, using a procedure involving minimisation of the error between measurement and model. Using linear estimators, tongue data is predicted from the face and vice versa, and the correlation between measurement and prediction is computed.

Full Paper

Bibliographic reference.  Beskow, Jonas / Engwall, Olov / Granström, Björn (2003): "Resynthesis of facial and intraoral articulation from simultaneous measurements", In ICPhS-15, 431-434.