Learning to Cluster with Auxiliary Tasks: A Semi-Supervised Approach

Autor(es)

Figueroa, Jhosimar Arias ; Rivera, Adin Ramirez ; IEEE

• Tipo de documento: Artigo Científico
• Fonte: 2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI); v. N/A, p. 8-pg., 2017-01-01.

Resumo

In this paper, we propose a model to learn a feature-category latent representation of the data, that is guided by a semi-supervised auxiliary task. The goal of this auxiliary task is to assign labels to unlabeled data and regularize the feature space. Our model is represented by a modified version of a Categorical Variational Autoencoder, i.e., a probabilistic generative model that approximates a categorical distribution with variational inference. We benefit from the autoencoder's architecture to learn powerful representations with Deep Neural Networks in an unsupervised way, and to optimize the model with semi-supervised tasks. We derived a loss function that integrates the probabilistic model with our auxiliary task to guide the learning process. Experimental results show the effectiveness of our method achieving more than 90% of clustering accuracy by using only 100 labeled examples. Moreover we show that the learned features have discriminative properties that can be used for classification. (AU)

• Processo FAPESP: 16/19947-6 - Desenvolvimento de arquiteturas de redes neurais Recurrente Convolucional para o reconhecimento de expressões faciais
• Beneficiário: Gerberth Adín Ramírez Rivera
• Modalidade de apoio: Auxílio à Pesquisa - Regular