Learning Vocabularies to Embed Graphs in Multimodal Rank Aggregation Tasks

Autor(es)

Dourado, Icaro Cavalcante ; Tones, Ricardo da Silva ; IEEE

• Tipo de documento: Artigo Científico
• Fonte: 2021 INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI); v. N/A, p. 6-pg., 2021-01-01.

Resumo

This paper introduces Supervised Bag of Graphs (SBoG), a supervised vocabulary learning approach for multimodal graph-based rank aggregation tasks. In our formulation, collection objects are represented based on complementary views provided by different ranks, defined in terms of multiple modalities. Ranks are encoded into a graph (fusion graph), which is later embedded into a vector representation (fusion vector), based on a vocabulary of graph words. SBoG explores different strategies for exploring collection labels to define suitable vocabularies that lead to effective representations. Experiments considered the use of SBoG-based representations in multimedia classification tasks. Obtained results demonstrate that SBoG leads to gains up to 28% when compared with state-of-the-art and traditional approaches. (AU)

• Processo FAPESP: 16/50250-1 - O segredo de jogar futebol: Brasil versus Holanda
• Beneficiário: Sergio Augusto Cunha
• Modalidade de apoio: Auxílio à Pesquisa - Temático
• Processo FAPESP: 14/12236-1 - AnImaLS: Anotação de Imagem em Larga Escala: o que máquinas e especialistas podem aprender interagindo?
• Beneficiário: Alexandre Xavier Falcão
• Modalidade de apoio: Auxílio à Pesquisa - Temático
• Processo FAPESP: 17/20945-0 - EMU concedido no processo 16/50250-1: local positioning system
• Beneficiário: Sergio Augusto Cunha
• Modalidade de apoio: Auxílio à Pesquisa - Programa Equipamentos Multiusuários
• Processo FAPESP: 15/24494-8 - Comunicação e processamento de big data em nuvens e névoas computacionais
• Beneficiário: Nelson Luis Saldanha da Fonseca
• Modalidade de apoio: Auxílio à Pesquisa - Temático