Busca avançada
Ano de início
Entree


Classification and Synthesis of Emotion in Sign Languages Using Neutral Expression Deviation Factor and 4D Trajectories

Texto completo
Autor(es):
Goncalves, Diego Addan ; Calani Baranauskas, Maria Cecilia ; Todt, Eduardo
Número total de Autores: 3
Tipo de documento: Artigo Científico
Fonte: ENTERPRISE INFORMATION SYSTEMS, ICEIS 2020; v. 417, p. 23-pg., 2021-01-01.
Resumo

3D Avatars are an efficient solution to complement the representation of sign languages in computational environments. A challenge, however, is to generate facial expressions realistically, without high computational cost in the synthesis process. This work synthesizes facial expressions with precise control through spatio-temporal parameters automatically. With parameters compatible with the gesture synthesis models for 3D avatars, it is possible to build complex expressions and interpolations of emotions through the model presented. The built method uses independent regions that allow the optimization of the animation synthesis process, reducing the computational cost and allowing independent control of the main facial regions. This work contributes to the definition of non-manual markers for 3D Avatar facia expression and its synthesis process. Also, a dataset with the base expressions was built where 4D information of the geometric control points of the avatar built for the experiments presented is found. The results of the generated outputs are validated in comparison with other expression classification approaches using Spatio-temporal data and machine learning, presenting superior accuracy for the base expressions. The rating is reinforced by evaluations conducted with the deaf community showing a positive acceptance of the facial expressions and synthesized emotions. (AU)

Processo FAPESP: 15/16528-0 - Sistemas sócio-enativos: investigando novas dimensões no design da interação mediada por tecnologias de informação e comunicação
Beneficiário:Maria Cecilia Calani Baranauskas
Modalidade de apoio: Auxílio à Pesquisa - Temático
Processo FAPESP: 19/12225-3 - Acessibilidade em sistemas sócio-enativos
Beneficiário:Diego Addan Gonçalves
Modalidade de apoio: Bolsas no Brasil - Pós-Doutorado
Processo FAPESP: 15/24300-9 - OpenDesign: técnicas e artefatos para o design socialmente consciente de sistemas computacionais
Beneficiário:Maria Cecilia Calani Baranauskas
Modalidade de apoio: Auxílio à Pesquisa - Regular