Speechreading of Brazilian Portuguese: training videos elaboration

• Grant number: 22/00801-2
• Support Opportunities: Scholarships in Brazil - Master
• Start date: May 01, 2022
• End date: August 31, 2023
• Field of knowledge: Interdisciplinary Subjects
• Principal Investigator: Sergio Sheiji Fukusima
• Grantee: Fernanda de Barros Vidal
• Host Institution: Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto (FFCLRP). Universidade de São Paulo (USP). Ribeirão Preto , SP, Brazil

Abstract

Lipreading studied within the theme of speech perception has several research developed in different languages. However, few studies have been carried out on this topic in Brazilian Portuguese. Speech perception can be studied through different approaches and by different areas of knowledge, including psychophysics, and is related to a bimodal (audiovisual) or unimodal (auditory or visual) association. Linked to psychophysics, this exploratory research proposes to develop a base of video files for training lipreading in Brazilian Portuguese, through natural stimuli, with words that contemplate different phonemes. For this, the work will be developed in three parts: mapping and selection of words by frequency of use in Brazilian Portuguese, production of exclusively visual stimulus videos, with a male and a female speaker pronouncing the selected words, and data collection and analysis. Data collection, which will take place online, will consist of an experimental session containing the videos produced with the words of stimulus, at the end of each video, participants must indicate an alternative of response and will receive feedback. A sample of 500 participants is estimated for validation of the videos in the experimental session. In this way, it is expected to contribute to the expansion of the investigation of the visual perception of speech and lipreading in Brazilian Portuguese. (AU)

Academic Publications

(References retrieved automatically from State of São Paulo Research Institutions)

VIDAL, Fernanda de Barros. Speechreading of Brazilian Portuguese: elaboration of videos for training. 2024. Master's Dissertation - Universidade de São Paulo (USP). Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto (PCARP/BC) Ribeirão Preto.