15th International Congress of Phonetic Sciences (ICPhS-15)

Barcelona, Spain
August 3-9, 2003

Visual Speech Interference in an Auditory Shadowing Task: The Dubbed Movie Effect

Jordi Navarra

Universitat de Barcelona, Spain

Experiment 1 was designed to investigate if incongruent linguistic lip movements interfere with the perception of auditory sentences. We tested Catalan/Spanish bilinguals with Spanish as L1 using a "shadowing task". The relevant auditory sentences (degraded with white noise) were synchronized with a silent video recording of a speaker pronouncing other sentences (in Catalan or Spanish) or energetically chewing gum. Only Spanish lip movements produced significant interference (as compared with the non-linguistic condition), although, there were no differences between Spanish and Catalan. A second experiment was designed to see if Catalan/Spanish bilinguals can discriminate between these languages using only visual information. Catalan/Spanish bilinguals can do this type of discrimination above chance, whereas English and Italian monolinguals cannot. This result highlights the importance of linguistic experience and rules out the role of extra-linguistic factors.

Full Paper

Bibliographic reference.  Navarra, Jordi (2003): "Visual speech interference in an auditory shadowing task: the dubbed movie effect", In ICPhS-15, 893-896.