| Full text | |
| Author(s): |
Leticio, Gustavo Rosseto
;
Valem, Lucas Pascotti
;
Lopes, Leonardo Tadeu
;
Guimaraes Pedronette, Daniel Carlos
Total Authors: 4
|
| Document type: | Journal article |
| Source: | PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023; v. N/A, p. 5-pg., 2023-01-01. |
| Abstract | |
The representation of multimedia content experienced tremendous advances in the last decades. Mainly supported by deep learning models, impressive results have been obtained. However, despite such advances in representation, the definition of similarity has been neglected. Effectively computing the similarity between representations remains a challenge. Traditional distance functions, such as the Euclidean distance, are not able to properly consider the relevant similarity information encoded in the dataset manifold. In fact, manifolds are essential to perception in many scenarios, such that exploiting the underlying structure of dataset manifolds plays a central role in multimedia content understanding and retrieval. In this paper, we present a framework for unsupervised distance learning which provides easy and uniform access to methods capable of considering the dataset manifold for redefining similarity. Such methods perform context-sensitive similarity learning based on more global measures, capable of improving the effectiveness of retrieval and machine learning tasks. The framework can use distance, similarity, or ranking information both as input and output and compute traditional retrieval effectiveness measures. Implemented as a wrapper in Python, the framework allows integration with a large number of Python libraries while keeping a back-end in C++ for efficiency. The paper also discusses diverse applications of the methods available in the pyUDLF framework, including image re-ranking, video retrieval, person re-ID, and pre-processing of distance measurements for clustering and classification. (AU) | |
| FAPESP's process: | 23/00694-4 - Consistent and explainable natural language inference |
| Grantee: | Daniel Carlos Guimarães Pedronette |
| Support Opportunities: | Regular Research Grants |
| FAPESP's process: | 18/15597-6 - Aplication and investigation of unsupervised learning methods in retrieval and classification tasks |
| Grantee: | Daniel Carlos Guimarães Pedronette |
| Support Opportunities: | Research Grants - Young Investigators Grants - Phase 2 |