3D audio: spatial audio acquisition, coding, and reproduction

• Grant number: 19/22945-3
• Support Opportunities: Scholarships in Brazil - Master
• Start date: March 01, 2020
• End date: February 28, 2022
• Field of knowledge: Engineering - Electrical Engineering - Telecommunications
• Principal Investigator: Bruno Sanches Masiero
• Grantee: Karen Gissell Rosero Jácome
• Host Institution: Faculdade de Engenharia Elétrica e de Computação (FEEC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
• Associated research grant: 17/08120-6 - 3D-Audio. Sampling, encoding and reproduction of spatial audio, AP.JP

Abstract

Technological advances in recent decades have resulted in a significant change in our relation with the media. The popularization of the Internet has allowed a huge amount of audio documents to be available anytime and from anywhere, a condition that has only been met thanks to encoding techniques that allow audio files to be compressed, with MP3 encoding being the most important of this process. On the other hand, the increasing popularity of home surround systems and the use of headphones associated with high-throughput portable phones allows the consolidation of spatial information as an integral element of the process and the phonographic product. This means, on the one hand, that coding techniques designed specifically for spatial audio files need to be developed, with the object-oriented audio format (AOO) being the most promising of these techniques. On the other hand, space audio capture and playback techniques need to be updated to meet the new requirements imposed by AOO. This project intends to act in the interfaces of spatial recording and reproduction, resulting in new algorithms of source separation and immersion evaluation of reproduction systems as well as equipment prototypes to be used with the AOO chain. At the same time, the project should assist in the creation of a research group in Communications Acoustics, a new area within an institution with a consolidated research tradition, such as Unicamp's Faculty of Electrical and Computer Engineering. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

ROSERO, KAREN; GRIJALVA, FELIPE; MASIERO, BRUNO. Sound Events Localization and Detection Using Bio-Inspired Gammatone Filters and Temporal Convolutional Neural Networks. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, v. 31, p. 11-pg., 2023-01-01. (17/08120-6, 19/22945-3)

Academic Publications

(References retrieved automatically from State of São Paulo Research Institutions)

JÁCOME, Karen Gissell Rosero. Avanços na detecção e localização de eventos sonoros usando filtros Gammatone e redes neurais convolucionais temporais. 2022. Master's Dissertation - Universidade Estadual de Campinas (UNICAMP). Faculdade de Engenharia Elétrica e de Computação Campinas, SP.