| Author(s): |
Roder, Mateus
;
de Rosa, Gustavo Henrique
;
Papa, Joao Paulo
;
Breve, Fabricio Aparecido
;
IEEE
Total Authors: 5
|
| Document type: | Journal article |
| Source: | 2020 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC); v. N/A, p. 8-pg., 2020-01-01. |
| Abstract | |
Restricted Boltzmann Machines (RBM) are stochastic neural networks mainly used for image reconstruction and unsupervised feature learning. An enhanced version, the temperature-based RBM (T-RBM), considers a new temperature parameter during the learning process that influences the neurons' activation. Nevertheless, the major vulnerability of such models concerns selecting an adequate system's temperature, which might lead them to inadequate training or even overfitting when wrongly set, thus limiting the network from predicting or working effectively over unseen data. This paper addresses the problem of selecting a suitable system's temperature through a meta-heuristic optimization process. Meta-heuristic-driven techniques, such as Particle Swarm Optimization, Bat Algorithm, and Artificial Bee Colony are employed to find proper values for the temperature parameter. Additionally, for comparison purposes, three standard temperature values and a random search are used as baselines. The results revealed that optimizing T-RBM is suitable for training purposes, primarily due to their complex fitness landscape, which makes fine-tuning temperatures a non-trivial task. (AU) | |
| FAPESP's process: | 19/02205-5 - Adversarial learning in natural language processing |
| Grantee: | Gustavo Henrique de Rosa |
| Support Opportunities: | Scholarships in Brazil - Doctorate |
| FAPESP's process: | 17/25908-6 - Weakly supervised learning for compressed video analysis on retrieval and classification tasks for visual alert |
| Grantee: | João Paulo Papa |
| Support Opportunities: | Research Grants - Research Partnership for Technological Innovation - PITE |
| FAPESP's process: | 19/07825-1 - Deep Boltzmann machines for event recognition in videos |
| Grantee: | Mateus Roder |
| Support Opportunities: | Scholarships in Brazil - Master |
| FAPESP's process: | 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry |
| Grantee: | Francisco Louzada Neto |
| Support Opportunities: | Research Grants - Research, Innovation and Dissemination Centers - RIDC |
| FAPESP's process: | 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction? |
| Grantee: | Alexandre Xavier Falcão |
| Support Opportunities: | Research Projects - Thematic Grants |