Taking Advantage of Highly-Correlated Attributes in Similarity Queries with Missing Values

Author(s):Show less -

Rodrigues, Lucas Santiago ; Cazzolato, Mirela Teixeira ; Machado Traina, Agma Juci ; Traina Jr, Caetano ; Satoh, S ; Zimek, A ; Bartolini, I ; Jonsson, BP ; Vadicamo, L ; Carrara, F ; Aumuller, M ; Pagh, R

• Document type: Journal article
• Source: SIMILARITY SEARCH AND APPLICATIONS, SISAP 2020; v. 12440, p. 9-pg., 2020-01-01.

Abstract

Incompleteness harms the quality of content-based retrieval and analysis in similarity queries. Missing data are usually evaluated using exclusion and imputation methods to infer possible values to complete gaps. However, such approaches can introduce bias into data and lose useful information. Similarity queries cannot perform over incomplete complex tuples, since distance functions are undefined over missing values. We propose the SOLID approach to allow similarity queries in complex databases without the need neither of data imputation nor deletion. First, SOLID finds highly-correlated metric spaces. Then, SOLID uses a weighted distance function to search by similarity over tuples of complex objects using compatibility factors among metric spaces. Experimental results show that SOLID outperforms imputation methods with different missing rates. SOLID was up to 7.3% better than the competitors in quality when querying over incomplete tuples, reducing 16.42% the error of similarity searches over incomplete data, and being up to 30.8 times faster than the closest competitor. (AU)

• FAPESP's process: 20/07200-9 - Analyzing complex data from COVID-19 to support decision making and prognosis
• Grantee: Agma Juci Machado Traina
• Support Opportunities: Regular Research Grants
• FAPESP's process: 18/24414-2 - A framework for integration of feature extraction techniques and complex databases for MIVisBD
• Grantee: Mirela Teixeira Cazzolato
• Support Opportunities: Scholarships in Brazil - Technical Training Program - Technical Training
• FAPESP's process: 16/17078-0 - Mining, indexing and visualizing Big Data in clinical decision support systems (MIVisBD)
• Grantee: Agma Juci Machado Traina
• Support Opportunities: Research Projects - Thematic Grants
• FAPESP's process: 20/10902-5 - Handling similarity queries over incomplete data in a Relational DBMS
• Grantee: Lucas Santiago Rodrigues
• Support Opportunities: Scholarships in Brazil - Technical Training Program - Technical Training