TeMIA-NT: ThrEat Monitoring and Intelligent data Analytics of Network Traffic

Author(s)

Guimaraes, Lucas C. B. ; Rebello, Gabriel Antonio F. ; Fernandes, Felipe S. ; Camilo, Gustavo F. ; de Souza, Lucas Airam C. ; dos Santos, Danyel C. ; de Oliveira, Luiz Gustavo C. M. ; Duarte, Otto Carlos M. B.

• Document type: Journal article
• Source: 2020 4TH CONFERENCE ON CLOUD AND INTERNET OF THINGS, CIOT; v. N/A, p. 8-pg., 2020-01-01.

Abstract

Cybernetic attacks have been increasingly common and cause great harm to people and organizations. Late detection of such attacks increases the possibility of irreparable damage, with high financial losses being a common occurrence. This article proposes TeMIA-NT (ThrEat Monitoring and Intelligent data Analytics of Network Traffic), a real-time flow analysis system that uses parallel flow processing. The main contributions of the TeMIA-NT are: i) the proposal of an architecture for real-time detection of network intrusions that supports high traffic rates, ii) the use of the structured streaming library, and iii) two modes of operation: offline and online. The offline operation mode allows evaluating the performance of multiple machine learning algorithms over a given dataset, including metrics such as accuracy, F1-score, and area under the curve (AUC). The proposal uses dataframe structures, in online mode, the structured streaming library in continuous mode, which allows detection of threats in real-time and a quick reaction to attacks. To prevent or minimize the damage caused by security attacks, TeMIA-NT achieves flow-processing rates that reach 50 GB/s.(1) (AU)

• FAPESP's process: 15/24485-9 - Future internet for smart cities
• Grantee: Fabio Kon
• Support Opportunities: Research Projects - Thematic Grants
• FAPESP's process: 14/50937-1 - INCT 2014: on the Internet of the Future
• Grantee: Fabio Kon
• Support Opportunities: Research Projects - Thematic Grants
• FAPESP's process: 18/23292-0 - ACCRUE-SFI project: advanced collaborative research infrastructure for secure future internet
• Grantee: Otto Carlos Muniz Bandeira Duarte
• Support Opportunities: Regular Research Grants
• FAPESP's process: 15/24514-9 - Stream project: security in real-time with elasticity, analytic, and monitoring
• Grantee: Otto Carlos Muniz Bandeira Duarte
• Support Opportunities: Regular Research Grants