| Full text | |
| Author(s): |
de Moraes Junior, Marcelo Isaias
;
Marcacini, Ricardo Marcondes
;
IEEE
Total Authors: 3
|
| Document type: | Journal article |
| Source: | 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN; v. N/A, p. 8-pg., 2023-01-01. |
| Abstract | |
Network embedding methods map nodes into vector representations, aiming to preserve important properties of relationships between nodes through similarities in a latent vectorspace model. Graph Neural Networks (GNNs) based on aggregate functions have received significant attention among different network embedding methods. In general, the embeddings of a node are recursively generated by aggregating embeddings from neighboring nodes. Aggregation is a crucial step in these methods, and different aggregation functions have been proposed, from simple averaging and max pooling operations to complex functions based on attention mechanisms. However, we note that there is a lack of studies comparing aggregate functions, especially in more practical real-world scenarios involving semi-supervised tasks. This paper introduces a methodology to evaluate different aggregation functions for semi-supervised learning through a model selection strategy guided by a statistical significance analysis framework. We show that Transformers-based aggregation functions are competitive for semi-supervised scenarios and obtain relevant results in different domains. Furthermore, we also discuss scenarios where "less is more", mainly when there are constraints on the availability of computational resources. (AU) | |
| FAPESP's process: | 22/09091-8 - Criminality, insecurity, and legitimacy: a transdisciplinary approach |
| Grantee: | Luis Gustavo Nonato |
| Support Opportunities: | Research Grants - eScience and Data Science Program - Thematic Grants |
| FAPESP's process: | 19/25010-5 - Semantically enriched representations for Portuguese textmining: models and applications |
| Grantee: | Solange Oliveira Rezende |
| Support Opportunities: | Regular Research Grants |
| FAPESP's process: | 19/07665-4 - Center for Artificial Intelligence |
| Grantee: | Fabio Gagliardi Cozman |
| Support Opportunities: | Research Grants - Research Program in eScience and Data Science - Research Centers in Engineering Program |