Multi-dimensional analysis of online data stream processing systems

• Grant number: 15/01657-9
• Support Opportunities: Regular Research Grants
• Start date: June 01, 2015
• End date: May 31, 2017
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computer Systems
• Principal Investigator: André Leon Sampaio Gradvohl
• Grantee: André Leon Sampaio Gradvohl
• Host Institution: Faculdade de Tecnologia (FT). Universidade Estadual de Campinas (UNICAMP). Limeira , SP, Brazil

Abstract

The concept of Big Data refers to a large array of data (large volume), produced at a high-speed rate (velocity) and in a variety of different formats. Big Data requires systems to process this volume of data quickly. There are systems that work with offline data, i.e. data that have been collected and are stored in non-structured databases. However, other more complex systems treat this data online, in real time, as soon as produced. These systems for online data stream processing are relatively new and have less than five years in production. In addition, currently they are distributed systems in order to increase their processing power. However, these systems still require improvements, especially in the following dimensions: elasticity, scalability, fault tolerance, high availability and processing speed. This project will develop studies to establish metrics for performance analysis of these systems and propose strategies to increase the availability and fault tolerance in components of such systems, without much sacrifice in their performance. One of the expected results is the creation of a benchmark system that will serve as a tool to analyze the behavior of online data stream processing systems in a controlled environment. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

GRADVOHL, ANDRE LEON S.; AWAN, I; YOUNAS, M; PORTELA, F. Metrics and Tool for Evaluating Data Stream Processing Systems. 2018 IEEE 6TH INTERNATIONAL CONFERENCE ON FUTURE INTERNET OF THINGS AND CLOUD WORKSHOPS (W-FICLOUD 2018), v. N/A, p. 8-pg., 2018-01-01. (15/01657-9)