Advanced search
Start date
Betweenand
(Reference retrieved automatically from Web of Science through information on FAPESP grant and its corresponding number as mentioned in the publication by the authors.)

Generative Adversarial Networks in Human Emotion Synthesis: A Review

Full text
Author(s):
Hajarolasvadi, Noushin [1] ; Ramirez, Miguel Arjona [2] ; Beccaro, Wesley [2] ; Demirel, Hasan [1]
Total Authors: 4
Affiliation:
[1] Eastern Mediterranean Univ, Elect & Elect Engn Dept, TR-99628 Gazimagusa - Turkey
[2] Univ Sao Paulo, Dept Elect Syst Engn, BR-05508010 Sao Paulo - Brazil
Total Affiliations: 2
Document type: Review article
Source: IEEE ACCESS; v. 8, p. 218499-218529, 2020.
Web of Science Citations: 0
Abstract

Deep generative models have become an emerging topic in various research areas like computer vision and signal processing. These models allow synthesizing realistic data samples that are of great value for both academic and industrial communities. Affective computing, a topic of a broad interest in computer vision society, has been no exception and has benefited from this powerful approach. In fact, affective computing observed a rapid derivation of generative models during the last two decades. Applications of such models include but are not limited to emotion recognition and classification, unimodal emotion synthesis, and cross-modal emotion synthesis. As a result, we conducted a comprehensive survey of recent advances in human emotion synthesis by studying available databases, advantages, and disadvantages of the generative models along with the related training strategies considering two principal human communication modalities, namely audio and video. In this context, facial expression synthesis, speech emotion synthesis, and the audio-visual (cross-modal) emotion synthesis are reviewed extensively under different application scenarios. Gradually, we discuss open research problems to push the boundaries of this research area for future works. As conclusions, we indicate common problems that can be explored from the Generative Adversarial Networks (GAN) topologies and applications in emotion synthesis. (AU)

FAPESP's process: 19/07665-4 - Center for Artificial Intelligence
Grantee:Fabio Gagliardi Cozman
Support Opportunities: Research Grants - Research Program in eScience and Data Science - Research Centers in Engineering Program
FAPESP's process: 18/12579-7 - ELIOT: enabling technologies for IoT
Grantee:Vitor Heloiz Nascimento
Support Opportunities: Research Projects - Thematic Grants
FAPESP's process: 18/26455-8 - Audio-Visual Speech Processing by Machine Learning
Grantee:Miguel Arjona Ramírez
Support Opportunities: Regular Research Grants