Autor(es)

Leticio, Gustavo Rosseto ; Valem, Lucas Pascotti ; Lopes, Leonardo Tadeu ; Guimaraes Pedronette, Daniel Carlos

• Tipo de documento: Artigo Científico
• Fonte: PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023; v. N/A, p. 5-pg., 2023-01-01.

Resumo

The representation of multimedia content experienced tremendous advances in the last decades. Mainly supported by deep learning models, impressive results have been obtained. However, despite such advances in representation, the definition of similarity has been neglected. Effectively computing the similarity between representations remains a challenge. Traditional distance functions, such as the Euclidean distance, are not able to properly consider the relevant similarity information encoded in the dataset manifold. In fact, manifolds are essential to perception in many scenarios, such that exploiting the underlying structure of dataset manifolds plays a central role in multimedia content understanding and retrieval. In this paper, we present a framework for unsupervised distance learning which provides easy and uniform access to methods capable of considering the dataset manifold for redefining similarity. Such methods perform context-sensitive similarity learning based on more global measures, capable of improving the effectiveness of retrieval and machine learning tasks. The framework can use distance, similarity, or ranking information both as input and output and compute traditional retrieval effectiveness measures. Implemented as a wrapper in Python, the framework allows integration with a large number of Python libraries while keeping a back-end in C++ for efficiency. The paper also discusses diverse applications of the methods available in the pyUDLF framework, including image re-ranking, video retrieval, person re-ID, and pre-processing of distance measurements for clustering and classification. (AU)

• Processo FAPESP: 23/00694-4 - Inferência em linguagem natural de forma consistente e explicável
• Beneficiário: Daniel Carlos Guimarães Pedronette
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Processo FAPESP: 18/15597-6 - Aplicação e investigação de métodos de aprendizado não-supervisionado em tarefas de recuperação e classificação
• Beneficiário: Daniel Carlos Guimarães Pedronette
• Modalidade de apoio: Auxílio à Pesquisa - Jovens Pesquisadores - Fase 2