Advanced search
Start date
(Reference retrieved automatically from Web of Science through information on FAPESP grant and its corresponding number as mentioned in the publication by the authors.)

A fast unsupervised preprocessing method for network monitoring

Full text
Lopez, Martin Andreoni [1, 2] ; Mattos, Diogo M. F. [3] ; Duarte, Otto Carlos M. B. [1] ; Pujolle, Guy [2]
Total Authors: 4
[1] Univ Fed Rio de Janeiro, COPPE, GTA, Rio de Janeiro - Brazil
[2] Sorbonne Univ, CNRS, Lab Informat Paris 6, F-75005 Paris - France
[3] Univ Fed Fluminense, Niteroi, RJ - Brazil
Total Affiliations: 3
Document type: Journal article
Source: ANNALS OF TELECOMMUNICATIONS; v. 74, n. 3-4, SI, p. 139-155, APR 2019.
Web of Science Citations: 0

Identifying a network misuse takes days or even weeks, and network administrators usually neglect zero-day threats until a large number of malicious users exploit them. Besides, security applications, such as anomaly detection and attack mitigation systems, must apply real-time monitoring to reduce the impacts of security incidents. Thus, information processing time should be as small as possible to enable an effective defense against attacks. In this paper, we present a fast preprocessing method for network traffic classification based on feature correlation and feature normalization. Our proposed method couples a normalization and feature selection algorithms. We evaluate the proposed algorithms against three different datasets for eight different machine learning classification algorithms. Our proposed normalization algorithm reduces the classification error rate when compared with traditional methods. Our feature selection algorithm chooses an optimized subset of features improving accuracy by more than 11% within a 100-fold reduction in processing time when compared to traditional feature selection and feature reduction algorithms. The preprocessing method is performed in batch and streaming data, being able to detect concept-drift. (AU)

FAPESP's process: 15/24485-9 - Future internet for smart cities
Grantee:Fabio Kon
Support type: Research Projects - Thematic Grants
FAPESP's process: 14/50937-1 - INCT 2014: on the Internet of the Future
Grantee:Fabio Kon
Support type: Research Projects - Thematic Grants
FAPESP's process: 15/24514-9 - Stream project: security in real-time with elasticity, analytic, and monitoring
Grantee:Otto Carlos Muniz Bandeira Duarte
Support type: Regular Research Grants