Auditory and visual cues integration in speech perception: developmental analysis

• Grant number: 21/15214-2
• Support Opportunities: Scholarships in Brazil - Doctorate
• Start date: December 01, 2022
• End date: January 31, 2026
• Field of knowledge: Linguistics, Literature and Arts - Linguistics - Linguistic Theory and Analysis
• Principal Investigator: Larissa Cristina Berti
• Grantee: Mayara Ferreira de Assis
• Host Institution: Faculdade de Filosofia e Ciências (FFC). Universidade Estadual Paulista (UNESP). Campus de Marília. Marília , SP, Brazil

Abstract

The objective of this study is compare the cues integration in children and adults with typical speech developmental. Assuming that age could influence in integrate audiovisual cues, and perceptual performance is dependent of age, it is assumed that: children have a worse performance in the integration of auditory and visual cues than adults, improvement in the performance of visual condition from the age of six. Seventy-five participants will test divided by 5 groups: (G1) children aged 4-5 years; (G2) children aged 6-8 years; (G3) children aged 9-10 years; (G4) children aged 11-12 years; (G5) children aged 20-30 years. Using the OpenSesame software, the presented stimuli will consist of audio and video recordings of the production of syllables with simple syllabic pattern so that the onset is filled by the fricatives: /f/, /s/ and /ƒ/ in context of the vowel /a/. The multimodal perception task will involve the stimuli presentation only by auditory pathway; (2) the stimuli presentation only by visual pathway; and (3a) simultaneous presentation of the auditory and visual stimuli congruently; (3b) simultaneous presentation of the auditory and visual stimuli incongruously. In order to analyze the data, it will be considered (1) accuracy (% of correct answers) and response time only in the auditory identification task; (2) accuracy and response time only in the visual identification task; and (3a) accuracy in identification task in audiovisual integration for congruent and incongruent stimuli. An inferential statistical analysis will be done to verify if there is difference between the groups and the conditions of stimuli presentation. It is believed that the proposal could contribute to scientific gains, such as: (1) to provide original information on the integration of cues in the perception of contrasts between voiceless fricatives in BP; (2) to verify how children and adults perceive information from integrated audiovisual stimuli. (AU)