Empirical Study of Multi-Task Hourglass Model for Semantic Segmentation Task

Autor(es)

Saire, Darwin ^[1] ; Rivera, Adin Ramirez ^[1]

Afiliação do(s) autor(es)

^[1] Univ Estadual Campinas, Inst Comp, BR-13083852 Campinas - Brazil

• Tipo de documento: Artigo Científico
• Fonte: IEEE ACCESS; v. 9, p. 80654-80670, 2021.
• Citações Web of Science: 0

Resumo

The semantic segmentation (SS) task aims to create a dense classification by labeling at the pixel level each object present on images. Convolutional neural network (CNN) approaches have been widely used, and exhibited the best results in this task. However, the loss of spatial precision on the results is a main drawback that has not been solved. In this work, we propose to use a multi-task approach by complementing the semantic segmentation task with edge detection, semantic contour, and distance transform tasks. We propose that by sharing a common latent space, the complementary tasks can produce more robust representations that can enhance the semantic labels. We explore the influence of contour-based tasks on latent space, as well as their impact on the final results of SS. We demonstrate the effectiveness of learning in a multi-task setting for hourglass models in the Cityscapes, CamVid, and Freiburg Forest datasets by improving the state-of-the-art without any refinement post-processing. (AU)

• Processo FAPESP: 19/18678-0 - Segmentação Semântica Usando um Modelo de Aprendizagem Hourglass
• Beneficiário: Darwin Danilo Saire Pilco
• Modalidade de apoio: Bolsas no Exterior - Estágio de Pesquisa - Doutorado
• Processo FAPESP: 19/07257-3 - Aprendendo representações através de modelos generativos profundos em vídeo
• Beneficiário: Gerberth Adín Ramírez Rivera
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Processo FAPESP: 17/16597-7 - Segmentação Semântica em Vídeos
• Beneficiário: Darwin Danilo Saire Pilco
• Modalidade de apoio: Bolsas no Brasil - Doutorado