oward In-Network Intelligence: Running Distributed Artificial Neural Networks in the Data Plan

Author(s)

Saquetti, Mateus ^[1] ; Canofre, Ronaldo ^[2] ; Lorenzon, Arthur F. ^[2] ; Rossi, Fabio D. ^[3] ; Azambuja, Jose Rodrigo ^[1] ; Cordeiro, Weverton ^[1] ; Luizelli, Marcelo C. ^[2]

Affiliation

^[1] Fed Univ Rio Grande do Sul UFRGS, Inst Informat, BR-91501970 Porto Alegre, RS - Brazil

^[2] Fed Univ Pampa UNIPAMPA, Comp Sci Dept, BR-97546550 Alegrete - Brazil

^[3] Farroupilha Fed Inst IFFAR, BR-97541000 Alegrete - Brazil

• Document type: Journal article
• Source: IEEE COMMUNICATIONS LETTERS; v. 25, n. 11, p. 3551-3555, NOV 2021.
• Web of Science Citations: 0

Abstract

In this letter, we make a case for in-network intelligence in programmable data planes (PDPs) by taking the first steps toward running distributed Artificial Neural Networks (ANNs) in programmable switches. The main novelty of our research lies in distributing the neurons of an ANN into multiple switches instead of running an entire ANN in a single device. The many advantages of this approach include wider network flow visibility and better resource usage across switches and links. We discuss the research challenges involved in expressing neuron logic for PDPs, mapping neurons to switches, and enabling neuron communication. To tackle these challenges, we introduce PDP programming constructs for performing neuron computation, formalize an optimization model for neuron placement, and tailor in-band telemetry for neuron inter-communication using production flows. Results obtained with a P4 implementation evidence that our approach improves network management tasks while keeping their provisioning overhead similar to a baseline. (AU)

• FAPESP's process: 18/23092-1 - Telemetry orchestration in programmable data planes
• Grantee: Marcelo Caggiani Luizelli
• Support Opportunities: Regular Research Grants
• FAPESP's process: 20/05183-0 - SkyNet: towards smart data planes
• Grantee: Luciano Paschoal Gaspary
• Support Opportunities: Research Projects - Thematic Grants
• FAPESP's process: 20/05115-4 - Probing planning for In-band network telemetry
• Grantee: Fábio Diniz Rossi
• Support Opportunities: Regular Research Grants