The Role of the Auditory and Visual Modalities in the Perceptual Identification of Brazilian Portuguese Statements and Echo Questions - Traitement du Langage Parlé Accéder directement au contenu
Article Dans Une Revue Language and Speech Année : 2021

The Role of the Auditory and Visual Modalities in the Perceptual Identification of Brazilian Portuguese Statements and Echo Questions

Résumé

This paper presents the results of three perceptual experiments investigating the role of auditory and visual channels for the identification of statements and echo questions in Brazilian Portuguese. Ten Brazilian speakers (five male) were video-recorded (frontal view of the face) while they produced a sentence ("Como você sabe"), either as a statement (meaning "As you know.") or as an echo question (meaning "As you know?"). Experiments were set up with the two different intonation contours. Stimuli were presented in conditions with clear and degraded audio as well as congruent and incongruent information from both channels. Results show that Brazilian listeners were able to distinguish statements and questions prosodically and visually, with auditory performances being dominant over visual ones. In noisy conditions, the visual channel improved the interpretation of prosodic cues robustly, while it degraded them in conditions where the visual information is incongruent with the auditory information. This study confirms the previous findings on auditory and visual integration within speech perception, also when applied to prosodic patterns.

Domaines

Linguistique
Fichier principal
Vignette du fichier
The role of the auditory and visual modalities in the perceptual identification of Brazilian Portuguese.pdf (1.67 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02456308 , version 1 (27-08-2021)

Identifiants

Citer

Luma Miranda, Marc Swerts, João Antônio de Moraes, Albert Rilliard. The Role of the Auditory and Visual Modalities in the Perceptual Identification of Brazilian Portuguese Statements and Echo Questions. Language and Speech, 2021, 64 (1), pp.3-23. ⟨10.1177/0023830919898886⟩. ⟨hal-02456308⟩
212 Consultations
72 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More