Towards a Transformer-Based Pre-trained Model for IoT Traffic Classification

Autor(es)

Bazaluk, Bruna ; Hamdan, Mosab ; Ghaleb, Mustafa ; Gismalla, Mohammed S. M. ; da Silva, Flavio S. Correa ; Batista, Daniel Macedo

• Tipo de documento: Artigo Científico
• Fonte: PROCEEDINGS OF 2024 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, NOMS 2024; v. N/A, p. 7-pg., 2024-01-01.

Resumo

The classification of IoT traffic is important to improve efficiency and security of IoT-based networks, and state-of-the-art classification methods are based on Deep Learning. However, most of the current results require a big amount of data to be trained. This way, in real life situations, where there is a scarce amount of IoT traffic data, the models would not perform so well. Consequently, these models underperform outside their initial training conditions and fail to capture the complex characteristics of network traffic, rendering them inefficient and unreliable in real-world applications. In this paper, we propose a novel IoT Traffic Classification Transformer (ITCT) approach, utilizing the state-of-the-art transformer-based model named TabTransformer. The model, which is pre-trained on a large labeled MQTT-based IoT traffic dataset and may be fine-tuned with a small set of labeled data, showed promising results in various traffic classification tasks. Our experiments demonstrated that the ITCT model significantly outperforms existing models, achieving an overall accuracy of 82%. To support reproducibility and collaborative development, all associated code is made publicly available. (AU)

• Processo FAPESP: 15/24485-9 - Internet do futuro aplicada a cidades inteligentes
• Beneficiário: Fabio Kon
• Modalidade de apoio: Auxílio à Pesquisa - Temático
• Processo FAPESP: 21/06995-0 - Starling: segurança e alocação de recursos em B5G via técnicas de inteligência artificial
• Beneficiário: Daniel Macêdo Batista
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Processo FAPESP: 14/50937-1 - INCT 2014: da Internet do Futuro
• Beneficiário: Fabio Kon
• Modalidade de apoio: Auxílio à Pesquisa - Temático