| Texto completo | |
| Autor(es): |
Fatur Lessa, Joao Vicente
;
Marques, Jonatas Adilson
;
Parizotto, Ricardo
;
Gaspary, Luciano Paschoal
Número total de Autores: 4
|
| Tipo de documento: | Artigo Científico |
| Fonte: | NOMS 2025-2025 IEEE NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM; v. N/A, p. 10-pg., 2025-01-01. |
| Resumo | |
The emergence of data plane programmability motivated the offloading of inference based on Neural Networks (NNs) into network devices. Although performing inference in the data plane can provide faster results by doing computation at the line rate, the constraints of these devices make the offloading challenging. Existing solutions predominantly involve NN binarization or other simplifications to circumvent these constraints, and little emphasis is given to offloading standard NNs. In this paper, we present NEURALP4, an automated approach for generating full-fledged NN models to perform inference on packet forwarding devices. Because manually coding and configuring the NN would be laborious and error-prone, NEURALP4 automatically generates all necessary switch code and configuration files, supporting the offloading for diverse use cases. To execute all NN operations within the device's constraints, we distribute the NN layers across multiple network switches (labor division) and devise customized algorithms employing numerical conversion techniques and algebraic transformations. We implemented a proof-of-concept and conducted experiments considering five use cases. Our results show that NEURALP4 is as accurate as a traditional, server-only NN and that its incurred memory footprint is compatible with existing data plane devices. Furthermore, the system minimizes the manual effort required to write the NN code. (AU) | |
| Processo FAPESP: | 23/00673-7 - Inteligência distribuída em redes de comunicação e internet das coisas |
| Beneficiário: | Nelson Luis Saldanha da Fonseca |
| Modalidade de apoio: | Auxílio à Pesquisa - Temático |
| Processo FAPESP: | 20/05183-0 - SkyNet: rumo à era dos planos de dados inteligentes |
| Beneficiário: | Luciano Paschoal Gaspary |
| Modalidade de apoio: | Auxílio à Pesquisa - Temático |