Advanced search
Start date
Betweenand


Manifold information through neighbor embedding projection for image retrieval

Full text
Author(s):
Leticio, Gustavo Rosseto ; Kawai, Vinicius Sato ; Valem, Lucas Pascotti ; Pedronette, Daniel Carlos Guimaraes ; Torres, Ricardo da S.
Total Authors: 5
Document type: Journal article
Source: PATTERN RECOGNITION LETTERS; v. 183, p. 9-pg., 2024-05-07.
Abstract

Although studied for decades, constructing effective image retrieval remains an open problem in a wide range of relevant applications. Impressive advances have been made to represent image content, mainly supported by the development of Convolution Neural Networks (CNNs) and Transformer -based models. On the other hand, effectively computing the similarity between such representations is still challenging, especially in collections in which images are structured in manifolds. This paper introduces a novel solution to this problem based on dimensionality reduction techniques, often used for data visualization. The key idea consists in exploiting the spatial relationships defined by neighbor embedding data visualization methods, such as t-SNE and UMAP, to compute a more effective distance/similarity measure between images. Experiments were conducted on several widely -used datasets. Obtained results indicate that the proposed approach leads to significant gains in comparison to the original feature representations. Experiments also indicate competitive results in comparison with state-of-the-art image retrieval approaches. (AU)

FAPESP's process: 20/11366-0 - Support for computational environments and experiments execution: weakly-supervised and classification fusion methods
Grantee:Lucas Pascotti Valem
Support Opportunities: Scholarships in Brazil - Technical Training Program - Technical Training
FAPESP's process: 17/25908-6 - Weakly supervised learning for compressed video analysis on retrieval and classification tasks for visual alert
Grantee:João Paulo Papa
Support Opportunities: Research Grants - Research Partnership for Technological Innovation - PITE
FAPESP's process: 18/15597-6 - Aplication and investigation of unsupervised learning methods in retrieval and classification tasks
Grantee:Daniel Carlos Guimarães Pedronette
Support Opportunities: Research Grants - Young Investigators Grants - Phase 2