| Full text | |
| Author(s): |
Total Authors: 2
|
| Affiliation: | [1] Univ Fed Sao Carlos, Dept Comp, Sao Carlos, SP - Brazil
[2] Sao Paulo State Univ, Dept Comp, Bauru - Brazil
Total Affiliations: 2
|
| Document type: | Journal article |
| Source: | NEURAL PROCESSING LETTERS; v. 48, n. 1, p. 95-107, AUG 2018. |
| Web of Science Citations: | 1 |
| Abstract | |
Deep learning techniques have been paramount in the last years, mainly due to their outstanding results in a number of applications, that range from speech recognition to face-based user identification. Despite other techniques employed for such purposes, Deep Boltzmann Machines (DBMs) are among the most used ones, which are composed of layers of Restricted Boltzmann Machines stacked on top of each other. In this work, we evaluate the concept of temperature in DBMs, which play a key role in Boltzmann-related distributions, but it has never been considered in this context up to date. Therefore, the main contribution of this paper is to take into account this information, as well as the impact of replacing a standard Sigmoid function by another one and to evaluate their influence in DBMs considering the task of binary image reconstruction. We expect this work can foster future research considering the usage of different temperatures during learning in DBMs. (AU) | |
| FAPESP's process: | 14/16250-9 - On the parameter optimization in machine learning techniques: advances and paradigms |
| Grantee: | João Paulo Papa |
| Support Opportunities: | Regular Research Grants |
| FAPESP's process: | 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction? |
| Grantee: | Alexandre Xavier Falcão |
| Support Opportunities: | Research Projects - Thematic Grants |
| FAPESP's process: | 16/19403-6 - Energy-based learning models and their applications |
| Grantee: | João Paulo Papa |
| Support Opportunities: | Regular Research Grants |