Advanced search
Start date
Betweenand


kappa-Entropy Based Restricted Boltzmann Machines

Full text
Author(s):
Passos, Leandro Aparecido ; Santana, Marcos Cleison ; Moreira, Thierry ; Papa, Joao Paulo ; IEEE
Total Authors: 5
Document type: Journal article
Source: 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN); v. N/A, p. 8-pg., 2019-01-01.
Abstract

Restricted Boltzmann Machines achieved notorious popularity in the scientific community in the last decade due to outstanding results in a wide range of applications and also for providing the required mechanisms to build successful deep learning models, i.e., Deep Belief Networks and Deep Boltzmann Machines. However, their main bottleneck is related to the learning step, which is usually time-consuming. In this paper, we introduce a Sigmoid-like family of functions based on the Kaniadakis entropy formulation in the context of the RBM learning procedure. Experiments concerning binary image reconstruction are conducted in four public datasets to evaluate the robustness of the proposed approach. The results suggest that such a family of functions is suitable to increase the convergence rate when compared to standard functions employed by the research community. (AU)

FAPESP's process: 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry
Grantee:Francisco Louzada Neto
Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC
FAPESP's process: 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?
Grantee:Alexandre Xavier Falcão
Support Opportunities: Research Projects - Thematic Grants
FAPESP's process: 16/06441-7 - Semantic information retrieval in large video databases
Grantee:Jurandy Gomes de Almeida Junior
Support Opportunities: Regular Research Grants