14th International Congress of Phonetic Sciences (ICPhS-14)

San Francisco, CA, USA
August 1-7, 1999

Differences in Speechreading a Synthetic and a Natural Face

Tobias Öhman, Magnus Lundeberg

Centre for Speech Technology, KTH, Sweden

In this paper we describe a method to improve speech movements of synthetic faces. Intelligibility tests were used to find phonemes or groups of phonemes where a natural face was significantly better in transmitting audio-visual information compared to a synthetic face. Optical measurements of the speech movements of the human face were performed, and several visual features were identified which could account for the intelligibility differences. As an application of this method, we adjusted our visual speech synthesis according to the results. In a new audio-visual intelligibility test, we could confirm the improvements of the synthetic face.

Full Paper

Bibliographic reference.  Öhman, Tobias / Lundeberg, Magnus (1999): "Differences in speechreading a synthetic and a natural face", In ICPhS-14, 1097-1100.