Abstracting Big Data Processing Tools for Smart Cities

Author(s)

Magano, Fernanda de Camargo ; Braghetto, Kelly Rosa ; IEEE

• Document type: Journal article
• Source: 2018 IEEE 37TH INTERNATIONAL SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS WORKSHOPS (SRDSW 2018); v. N/A, p. 4-pg., 2018-01-01.

Abstract

Large volumes of data from various sources are generated continuously in cities. The processing and analysis of these data play a key role in the implementation of initiatives for smart cities. In order to process urban Big Data, it is essential to use high-performance tools to accelerate processing and provide quick answers. However, this use is not trivial because Big Data tools are not interoperable and require from their users knowledge of parallel and distributed computing and databases. In this work, we compare popular open-source Big Data processing frameworks and propose a software system to abstract and facilitate their use in smart city applications. The architecture of the system is composed by an interface to specify dataflow models as well as services to interpret these models and instantiate them in different Big Data tools. An implementation of the system on top of a smart city platform is also addressed. (AU)

• FAPESP's process: 14/50937-1 - INCT 2014: on the Internet of the Future
• Grantee: Fabio Kon
• Support Opportunities: Research Projects - Thematic Grants