Neighbor Embedding Projection and Rank-based Manifold Learning for Image Retrieval

Author(s)

Kawai, Vinicius Atsushi Sato ; Leticio, Gustavo Rosseto ; Valem, Lucas Pascotti ; Pedronette, Daniel Carlos Guimardes

• Document type: Journal article
• Source: 2024 37TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES, SIBGRAPI 2024; v. N/A, p. 6-pg., 2024-01-01.

Abstract

Despite the impressive advances in image understanding approaches, defining similarity among images remains a challenging task, crucial for many applications such as classification and retrieval. Mainly supported by Convolution Neural Networks (CNNs) and Transformer-based models, image representation techniques are the main reason for the advances. On the other hand, comparisons are mostly computed based on traditional pairwise measures, such as the Euclidean distance, while contextual similarity approaches can lead to effective results in defining similarity between points in high-dimensional spaces. This paper introduces a novel approach to contextual similarity by combining two techniques: neighbor embedding projection methods and rank-based manifold learning. High-dimensional features are projected in a 2D space used for efficiently ranking computation. Subsequently, manifold learning methods are exploited for a re-ranking step. An experimental evaluation conducted on different datasets and visual features indicates that the proposed approach leads to significant gains in comparison to the original feature representations and the neighbor embedding method in isolation. (AU)

• FAPESP's process: 18/15597-6 - Aplication and investigation of unsupervised learning methods in retrieval and classification tasks
• Grantee: Daniel Carlos Guimarães Pedronette
• Support Opportunities: Research Grants - Young Investigators Grants - Phase 2