| Full text | |
| Author(s): |
Cabral, Eugenio F.
;
Cordeiro, Robson L. F.
;
ASSOC COMP MACHINERY
Total Authors: 3
|
| Document type: | Journal article |
| Source: | CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT; v. N/A, p. 10-pg., 2020-01-01. |
| Abstract | |
Outlier detection is the task responsible for finding novel or rare phenomena that provide valuable insights in many areas of the industry. The neighborhood-based algorithms are largely used to tackle this problem due to the intuitive interpretation and wide applicability in different domains. Their major drawback is the intensive neighborhood search that takes hours or even days to complete in large data, thus being impractical in many real-world scenarios. This paper proposes HySortOD - a novel algorithm that uses an efficient hypercube-ordering-and-searching strategy for fast outlier detection. Its main focus is the analysis of data with many instances and a low-to-moderate number of dimensions. We performed comprehensive experiments using real data with up to similar to 500k instances and similar to 120 dimensions, where our new algorithm outperformed 7 state-of-the-art competitors in runtime, being up to 4 orders of magnitude faster in large data. Specifically, 12 well-known benchmark datasets were deeply investigated and one case study in the crucial task of breast cancer detection was also performed to demonstrate that our approach can be successfully used as an out-of-the-box solution for real-world, non-benchmark problems. Based on our experiments, we also identified default parameter values that allow us to be parameter-free and yet report high-quality results. (AU) | |
| FAPESP's process: | 18/05714-5 - Mining Frequent Data Streams of High Dimensionality with a Case Study in Digital Games |
| Grantee: | Robson Leonardo Ferreira Cordeiro |
| Support Opportunities: | Regular Research Grants |
| FAPESP's process: | 16/17078-0 - Mining, indexing and visualizing Big Data in clinical decision support systems (MIVisBD) |
| Grantee: | Agma Juci Machado Traina |
| Support Opportunities: | Research Projects - Thematic Grants |