Modelling Graph Neural Network by Aggregating the Activation Maps of Self-Organizing Map

Author(s)

Martins, Luan V. de C. ; Ji, Donghong ; Liang, Zhao

• Document type: Journal article
• Source: 2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024; v. N/A, p. 6-pg., 2024-01-01.

Abstract

The field of Graph Neural Networks (GNNs) has garnered significant attention for leveraging Neural Networks to analyze graph data. However, the inherent limitations of GNNs, arising from their aggregation function and injectivity constraints, restrict their ability to distinguish various topological neighborhood structures accurately. Consequently, after aggregation, different underlying graph structures may not be distinctly identified, impeding the model's representation capabilities. In this study, we introduce a novel GNN model that incorporates Self-Organizing Maps (SOM) to enhance the representation of node attributes and characterize the graph's neighborhood structure. Leveraging SOM, we transform the node's attribute space into a fixed-size grid, enabling the representation of neighborhood topology by overlaying activated regions, which allows the model to learn association rules based on the presence or absence of neighboring attributes. This process generates an injective graph embedding that uniquely captures different neighborhood structures. We evaluate the model on real-world datasets to assess its' performance, analyzing how SOM parameters influence its behavior and effectiveness. Through extensive experimentation, we demonstrate that our model achieves competitive and robust results with well-established GNN models. Our approach showcases the potential of using SOM to overcome limitations in current GNN architectures, providing a more effective and nuanced representation of graph data. (AU)

• FAPESP's process: 20/15129-2 - Focal and non-focal EEG classification through deep learning
• Grantee: Luan Vinícius de Carvalho Martins
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 19/07665-4 - Center for Artificial Intelligence
• Grantee: Fabio Gagliardi Cozman
• Support Opportunities: Research Grants - Research Program in eScience and Data Science - Research Centers in Engineering Program