| Full text | |
| Author(s): |
Presotto, Joao Gabriel Camacho
;
Valem, Lucas Pascotti
;
de Sa, Nikolas Gomes
;
Pedronette, Daniel Carlos Guimaraes
;
Papa, Joao Paulo
Total Authors: 5
|
| Document type: | Journal article |
| Source: | Neurocomputing; v. 589, p. 18-pg., 2024-04-24. |
| Abstract | |
Over the last decade, significant advances have been achieved by machine learning approaches, notably in supervised learning scenarios. Supported by the advent of deep learning and comprehensive training sets, the accuracy achieved on classification tasks has improved significantly. Simultaneously, we have experienced massive growth in multimedia data and applications, which have become ubiquitous in several domains. However, with the increase in multimedia data collections, significant bottlenecks associated with the lack of labeled data emerged. To surpass this critical issue, developing methods capable of exploiting the unlabeled data and operating under weak supervision has become imperative. This work proposes a rank -based model capable of using contextual information encoded in the unlabeled data to perform weakly supervised classification. We evaluated the proposed weakly supervised approach on multimedia classification tasks with and without manifold learning algorithms, considering several combinations of rank correlation measures and classifiers. An experimental evaluation was conducted on 6 public image datasets considering different features, including convolutional neural networks and visual transformers. Positive gains were achieved compared to supervised and semi-supervised baselines for the same amount of labeled data. For instance, the proposed approach with manifold learning enhanced the accuracy of the Optimum -Path Forest (OPF) classifier from 71.77% to 83.24% when applied to the Flowers dataset and ResNet features. Among the conclusions, this work reveals that rank -based correlation measures and manifold learning can be used for a more effective labeled set expansion. (AU) | |
| FAPESP's process: | 19/11104-8 - A comparative analysis of rank correlation measures for weakly-supervised learning |
| Grantee: | Nikolas Gomes de Sá |
| Support Opportunities: | Scholarships in Brazil - Scientific Initiation |
| FAPESP's process: | 20/11366-0 - Support for computational environments and experiments execution: weakly-supervised and classification fusion methods |
| Grantee: | Lucas Pascotti Valem |
| Support Opportunities: | Scholarships in Brazil - Technical Training Program - Technical Training |
| FAPESP's process: | 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction? |
| Grantee: | Alexandre Xavier Falcão |
| Support Opportunities: | Research Projects - Thematic Grants |
| FAPESP's process: | 18/15597-6 - Aplication and investigation of unsupervised learning methods in retrieval and classification tasks |
| Grantee: | Daniel Carlos Guimarães Pedronette |
| Support Opportunities: | Research Grants - Young Investigators Grants - Phase 2 |
| FAPESP's process: | 19/04754-6 - Weakly supervised learning strategies through Rank-based measures |
| Grantee: | João Gabriel Camacho Presotto |
| Support Opportunities: | Scholarships in Brazil - Master |
| FAPESP's process: | 17/25908-6 - Weakly supervised learning for compressed video analysis on retrieval and classification tasks for visual alert |
| Grantee: | João Paulo Papa |
| Support Opportunities: | Research Grants - Research Partnership for Technological Innovation - PITE |