Busca avançada
Ano de início
Entree


Facial Expressions Animation in Sign Language based on Spatio-temporal Centroid

Texto completo
Autor(es):
Goncalves, Diego Addan ; Calani Baranauskas, Maria Cecilia ; dos Reis, Julio Cesar ; Todt, Eduardo ; Filipe, J ; Smialek, M ; Brodsky, A ; Hammoudi, S
Número total de Autores: 8
Tipo de documento: Artigo Científico
Fonte: PROCEEDINGS OF THE 22ND INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS (ICEIS), VOL 2; v. N/A, p. 13-pg., 2020-01-01.
Resumo

Systems that use virtual environments with avatars for information communication are of fundamental importance in contemporary life. They are even more relevant in the context of supporting sign language communication for accessibility purposes. Although facial expressions provide message context and define part of the information transmitted, e.g., irony or sarcasm, facial expressions are usually considered as a static background feature in a primarily gestural language in computational systems. This article proposes a novel parametric model of facial expression synthesis through a 3D avatar representing complex facial expressions leveraging emotion context. Our technique explores interpolation of the base expressions in the geometric animation through centroids control and Spatio-temporal data. The proposed method automatically generates complex facial expressions with controllers that use region parameterization as in manual models used for sign language representation. Our approach to the generation of facial expressions adds emotion to representation, which is a determining factor in defining the tone of a message. This work contributes with the definition of non-manual markers for Sign Languages 3D Avatar and the refinement of the synthesized message in sign languages, proposing a complete model for facial parameters and synthesis using geometric centroid regions interpolation. A dataset with facial expressions was generated using the proposed model and validated using machine learning algorithms. In addition, evaluations conducted with the deaf community showed a positive acceptance of the facial expressions and synthesized emotions. (AU)

Processo FAPESP: 19/12225-3 - Acessibilidade em sistemas sócio-enativos
Beneficiário:Diego Addan Gonçalves
Modalidade de apoio: Bolsas no Brasil - Pós-Doutorado
Processo FAPESP: 15/24300-9 - OpenDesign: técnicas e artefatos para o design socialmente consciente de sistemas computacionais
Beneficiário:Maria Cecilia Calani Baranauskas
Modalidade de apoio: Auxílio à Pesquisa - Regular
Processo FAPESP: 15/16528-0 - Sistemas sócio-enativos: investigando novas dimensões no design da interação mediada por tecnologias de informação e comunicação
Beneficiário:Maria Cecilia Calani Baranauskas
Modalidade de apoio: Auxílio à Pesquisa - Temático