15th International Congress of Phonetic Sciences (ICPhS-15)

Barcelona, Spain
August 3-9, 2003

Benefit of Audiovisual Presentation in Close Shadowing Task

Denis Beautemps, Marie-Agnès Cathiard, Yvon Le Borgne

ICP-CNRS, France

Close shadowing paradigm consists in repetition of speech as soon as the speaker produces it. This paradigm was used for the evaluation of time co-perception and production process. We used this paradigm in order to evaluate the benefit of visual lip information in case of audiovisual presentation of stimuli with a perfectly audible signal. We presented French [VCVsa] sequences made of [a, i, u, y] vowels and [p, t, k] consonants pronounced by a male French speaker for both normally articulated and hyper articulated speech. Four subjects were asked to repeat on line syllables for stimuli presented in the two conditions: auditory alone and audiovisually. The average reaction times measured between stimulus onset acoustic closure of the consonant and the corresponding event on the response vary between 227 to 314 ms. We found no advantage for the hyper articulated production. But a significant advantage of audiovisual presentation with a visual gain of 35 ms and 49 ms (i.e. 13.4% and 14.6%) for two of the four subjects.

Full Paper

Bibliographic reference.  Beautemps, Denis / Cathiard, Marie-Agnès / Borgne, Yvon Le (2003): "Benefit of audiovisual presentation in close shadowing task", In ICPhS-15, 841-844.