Mining Frequent Data Streams of High Dimensionality with a Case Study in Digital Games

• Grant number: 18/05714-5
• Support Opportunities: Regular Research Grants
• Start date: July 01, 2018
• End date: June 30, 2020
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Robson Leonardo Ferreira Cordeiro
• Grantee: Robson Leonardo Ferreira Cordeiro
• Host Institution: Instituto de Ciências Matemáticas e de Computação (ICMC). Universidade de São Paulo (USP). São Carlos , SP, Brazil
• Associated researchers: Agma Juci Machado Traina ; Caetano Traina Junior ; Gustavo Enrique de Almeida Prado Alves Batista ; José Fernando Rodrigues Júnior

Abstract

In a data stream with many attributes and a high frequency of events, how to spot clusters of similar events? How to identify outlying events, and sort them according to how much they differ from the main data patterns? Can it be performed in real time? For example, based on the actions of users over time in an online digital game management system, how to identify clusters of users/players that share similar preferences, so to assist targeted marketing and the development of new games? How to automatically identify spammers, bots, hackers and famous players, aimed at banning users in the first three categories as well as understanding why those in the last category are famous? Today, there exists a need for accurate, fast and scalable algorithms able to extract patterns in real time from streams with many attributes and a high frequency of events, such as the many streams that are constantly collected by web systems and automated sensors from a variety of modern applications. This project aims to reduce the aforementioned issue focused on clustering and outlier detection in streams with thousands of new events received per second, each one described by tens/hundreds of attributes. The new methodologies and algorithms to be developed will be validated in a case study with the analysis of streams from a digital game management system that controls online matches worldwide, as well as the creation/publication of new content for the game Super Mario Maker, from the developer Nintendo Company Ltd.. (AU)

Scientific publications

(8)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

MILON-FLORES, DANIELA F.; CORDEIRO, ROBSON L. F.. How to take advantage of behavioral features for the early detection of grooming in online conversations. KNOWLEDGE-BASED SYSTEMS, v. 240, p. 29-pg., 2022-01-22. (20/07200-9, 16/17078-0, 18/05714-5)

MONTEIRO OLIVEIRA, JADSON JOSE; FERREIRA CORDEIRO, ROBSON LEONARDO. Unsupervised dimensionality reduction for very large datasets: Are we going to the right direction?. KNOWLEDGE-BASED SYSTEMS, v. 196, MAY 21 2020. (16/17078-0, 18/05714-5)

ALVES, MATHEUS A. C.; CORDEIRO, ROBSON L. F.. Effective and unburdensome forecast of highway traffic flow with adaptive computing. KNOWLEDGE-BASED SYSTEMS, v. 212, JAN 5 2021. (20/07200-9, 18/05714-5, 16/17078-0)

PEREIRA MORAES, LEONARDO MAURO; FERREIRA CORDEIRO, ROBSON LEONARDO; FILIPE, J; SMIALEK, M; BRODSKY, A; HAMMOUDI, S. Detecting Influencers in Very Large Social Networks of Games. PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS (ICEIS 2019), VOL 2, v. N/A, p. 11-pg., 2019-01-01. (18/05714-5)

TRAINA, CAETANO, JR.; MORIYAMA, ANDRE; ROCHA, GUILHERME; CORDEIRO, ROBSON; CIFERRI, CRISTINA D. A.; TRAINA, AGMA; ASSOC COMP MACHINERY. The SIMILARQL framework: similarity queries in plain SQL. SAC '19: PROCEEDINGS OF THE 34TH ACM/SIGAPP SYMPOSIUM ON APPLIED COMPUTING, v. N/A, p. 4-pg., 2019-01-01. (18/05714-5, 16/17078-0, 18/22277-8)

BISPO JUNIOR, ALTAMIR GOMES; FERREIRA CORDEIRO, ROBSON LEONARDO; RODRIGUES, JMF; CARDOSO, PJS; MONTEIRO, J; LAM, R; KRZHIZHANOVSKAYA, VV; LEES, MH; DONGARRA, JJ; SLOOT, PMA. Fast and Scalable Outlier Detection with Metric Access Methods. COMPUTATIONAL SCIENCE - ICCS 2019, PT II, v. 11537, p. 15-pg., 2019-01-01. (16/17078-0, 18/05714-5)

GONZAGA, ANDRE DOS SANTOS; CORDEIRO, ROBSON L. F.. The similarity-aware relational division database operator with case studies in agriculture and genetics. INFORMATION SYSTEMS, v. 82, p. 71-87, MAY 2019. (18/05714-5, 15/05607-6, 14/21483-2)

CABRAL, EUGENIO F.; CORDEIRO, ROBSON L. F.; ASSOC COMP MACHINERY. Fast and Scalable Outlier Detection with Sorted Hypercubes. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, v. N/A, p. 10-pg., 2020-01-01. (18/05714-5, 16/17078-0)