| Full text | |
| Author(s): |
de Almeida, Lucas Barbosa
;
Valem, Lucas Pascotti
;
Guimaraes Pedronette, Daniel Carlos
;
IEEE
Total Authors: 4
|
| Document type: | Journal article |
| Source: | 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP; v. N/A, p. 5-pg., 2022-01-01. |
| Abstract | |
Despite the impressive advances obtained by supervised deep learning approaches on retrieval and classification tasks, how to acquire labeled data for training remains a challenging bottleneck. In this scenario, the need for developing more effective content-based retrieval approaches capable of taking advantage of multimodal information and advances in unsupervised learning becomes imperative. Based on such observations, we propose two novel approaches that combine Graph Convolutional Networks (GCNs) with rank-based manifold learning methods. The GCN models were trained in an unsupervised way, using the Deep Graph Infomax algorithm, and the proposed approaches employ recent rank-based manifold learning methods. Multimodal information is exploited through pre-trained CNNs via transfer learning for extracting audio, image, and video features. The proposed approaches were evaluated on three public action recognition datasets. High-effective results were obtained, reaching relative gains up to +29.44% of MAP compared to baseline approaches without GCNs. The experimental evaluation also considered classical and recent baselines in the literature. (AU) | |
| FAPESP's process: | 20/11366-0 - Support for computational environments and experiments execution: weakly-supervised and classification fusion methods |
| Grantee: | Lucas Pascotti Valem |
| Support Opportunities: | Scholarships in Brazil - Technical Training Program - Technical Training |
| FAPESP's process: | 18/15597-6 - Aplication and investigation of unsupervised learning methods in retrieval and classification tasks |
| Grantee: | Daniel Carlos Guimarães Pedronette |
| Support Opportunities: | Research Grants - Young Investigators Grants - Phase 2 |
| FAPESP's process: | 20/03311-0 - Unsupervised learning for general and multimodal multimedia retrieval |
| Grantee: | Lucas Barbosa de Almeida |
| Support Opportunities: | Scholarships in Brazil - Master |