Network science for optimizing artificial neural networks on computer vision

• Grant number: 21/09163-6
• Support Opportunities: Scholarships abroad - Research Internship - Doctorate
• Start date: January 12, 2022
• End date: January 11, 2023
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Odemir Martinez Bruno
• Grantee: Leonardo Felipe dos Santos Scabini
• Supervisor: Bernard de Baets
• Host Institution: Instituto de Física de São Carlos (IFSC). Universidade de São Paulo (USP). São Carlos , SP, Brazil
• Institution abroad: Ghent University (UGent), Belgium
• Associated to the scholarship: 19/07811-0 - Artificial neural networks and complex networks: an integrative study of topological properties and pattern recognition, BP.DR

Abstract

Computer Vision is one of the most diffused areas within Machine Learning and where most of the deep Artificial Neural Networks (ANNs) have emerged. Although these models achieve outstanding results on large vision tasks, their ever-increasing complexity hampers a better understanding of their internal functioning. Consequently, most methods for architecture design and optimization usually are based on randomness and trial-and-error searches. Therefore, we propose to use Network Science for improving ANNs on Computer Vision. On most of these models, neurons and synapses can be directly modeled as Complex Networks (CN). We compute several topological characteristics based on neuronal centrality from this graph representation then a clustering technique highlights the most relevant neuron types. The distribution of these neuron types represents the overall structure of the ANN, which we analyze in correlation to the model's accuracy. Our methodology allows establishing a link between topology and performance for developing mechanisms to optimize them, where we will consider architecture engineering (construction/initialization) and optimization (compression/adaptation). One of the benefits of this approach is that the obtained models are more theoretically plausible within Network Science. We will consider this approach on different neural architectures and explore their applicability for specific and small-scale tasks such as texture analysis. The developed methods will also be analyzed in multidisciplinary applications from research collaborations at the host university. The development of applied methods is a crucial step of the Ph.D., and the stay in a top-international center will also strengthen the collaboration network of our research group. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

SCABINI, LEONARDO; RIBAS, LUCAS; RIBEIRO, ERALDO; BRUNO, ODEMIR; RIBEIRO, P; SILVA, F; MENDES, JF; LAUREANO, R. Deep Topological Embedding with Convolutional Neural Networks for Complex Network Classification. NETWORK SCIENCE (NETSCI-X 2022), v. 13197, p. 13-pg., 2022-01-01. (16/18809-9, 21/09163-6, 14/08026-1, 19/07811-0, 16/23763-8)

SCABINI, LEONARDO; ZIELINSKI, KALLIL M.; RIBAS, LUCAS C.; GONCALVES, WESLEY N.; DE BAETS, BERNARD; BRUNO, ODEMIR M.. RADAM: Texture recognition through randomized aggregated encoding of deep activation maps. PATTERN RECOGNITION, v. 143, p. 13-pg., 2023-11-01. (22/03668-1, 21/09163-6, 18/22214-6, 21/07289-2, 21/08325-2, 19/07811-0)