Busca avançada
Ano de início
Entree


OPTIMIZING TIME DOMAIN FULLY CONVOLUTIONAL NETWORKS FOR 3D SPEECH ENHANCEMENT IN A REVERBERANT ENVIRONMENT USING PERCEPTUAL LOSSES

Texto completo
Autor(es):
Guimaraes, Heitor R. ; Beccaro, Wesley ; Ramirez, Miguel A. ; IEEE
Número total de Autores: 4
Tipo de documento: Artigo Científico
Fonte: 2021 IEEE 31ST INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP); v. N/A, p. 6-pg., 2021-01-01.
Resumo

Noise in 3D reverberant environment is detrimental to several downstream applications. In this work, we propose a novel approach to 3D speech enhancement directly in the time domain through the usage of Fully Convolutional Networks (FCN) with a custom loss function based on the combination of a perceptual loss, built on top of the wav2vec model and a soft version of the short-time objective intelligibility (STOI) metric. The dataset and experiments were based on Task 1 of the L3DAS21 challenge. Our model achieves a STOI score of 0.82, word error rate (WER) equal to 0.36, and a score of 0.73 in the metric proposed by the challenge based on STOI and WER combination using as reference the development set. Our submission, based on this method, was ranked second in Task 1 of the L3DAS21 challenge. (AU)

Processo FAPESP: 19/07665-4 - Centro de Inteligência Artificial
Beneficiário:Fabio Gagliardi Cozman
Modalidade de apoio: Auxílio à Pesquisa - Programa eScience e Data Science - Centros de Pesquisa em Engenharia
Processo FAPESP: 18/26455-8 - Processamento Audiovisual de Voz por Aprendizagem de Máquina
Beneficiário:Miguel Arjona Ramírez
Modalidade de apoio: Auxílio à Pesquisa - Regular