Weakly supervised classification through manifold learning and rank-based contextual measures

Autor(es)

Presotto, Joao Gabriel Camacho ; Valem, Lucas Pascotti ; de Sa, Nikolas Gomes ; Pedronette, Daniel Carlos Guimaraes ; Papa, Joao Paulo

• Tipo de documento: Artigo Científico
• Fonte: Neurocomputing; v. 589, p. 18-pg., 2024-04-24.

Resumo

Over the last decade, significant advances have been achieved by machine learning approaches, notably in supervised learning scenarios. Supported by the advent of deep learning and comprehensive training sets, the accuracy achieved on classification tasks has improved significantly. Simultaneously, we have experienced massive growth in multimedia data and applications, which have become ubiquitous in several domains. However, with the increase in multimedia data collections, significant bottlenecks associated with the lack of labeled data emerged. To surpass this critical issue, developing methods capable of exploiting the unlabeled data and operating under weak supervision has become imperative. This work proposes a rank -based model capable of using contextual information encoded in the unlabeled data to perform weakly supervised classification. We evaluated the proposed weakly supervised approach on multimedia classification tasks with and without manifold learning algorithms, considering several combinations of rank correlation measures and classifiers. An experimental evaluation was conducted on 6 public image datasets considering different features, including convolutional neural networks and visual transformers. Positive gains were achieved compared to supervised and semi-supervised baselines for the same amount of labeled data. For instance, the proposed approach with manifold learning enhanced the accuracy of the Optimum -Path Forest (OPF) classifier from 71.77% to 83.24% when applied to the Flowers dataset and ResNet features. Among the conclusions, this work reveals that rank -based correlation measures and manifold learning can be used for a more effective labeled set expansion. (AU)

• Processo FAPESP: 19/11104-8 - Uma análise comparativa de métricas de correlação de ranqueamento para aprendizado fracamente supervisionado
• Beneficiário: Nikolas Gomes de Sá
• Modalidade de apoio: Bolsas no Brasil - Iniciação Científica
• Processo FAPESP: 20/11366-0 - Suporte para ambiente computacional e execução de experimentos: aprendizado fracamente supervisionado e fusão de métodos de classificação
• Beneficiário: Lucas Pascotti Valem
• Modalidade de apoio: Bolsas no Brasil - Programa Capacitação - Treinamento Técnico
• Processo FAPESP: 14/12236-1 - AnImaLS: Anotação de Imagem em Larga Escala: o que máquinas e especialistas podem aprender interagindo?
• Beneficiário: Alexandre Xavier Falcão
• Modalidade de apoio: Auxílio à Pesquisa - Temático
• Processo FAPESP: 18/15597-6 - Aplicação e investigação de métodos de aprendizado não-supervisionado em tarefas de recuperação e classificação
• Beneficiário: Daniel Carlos Guimarães Pedronette
• Modalidade de apoio: Auxílio à Pesquisa - Jovens Pesquisadores - Fase 2
• Processo FAPESP: 19/04754-6 - Aprendizado fracamente supervisionado baseado em métricas de Ranqueamentto
• Beneficiário: João Gabriel Camacho Presotto
• Modalidade de apoio: Bolsas no Brasil - Mestrado
• Processo FAPESP: 17/25908-6 - Aprendizado fracamente supervisionado para análise de vídeos no domínio comprimido em tarefas de recuperação e classificação para alertas visuais
• Beneficiário: João Paulo Papa
• Modalidade de apoio: Auxílio à Pesquisa - Parceria para Inovação Tecnológica - PITE