Advanced search
Start date
Betweenand

On the influence of Markovian models for Restricted Boltzmann Machines training

Grant number: 15/00478-3
Support type:Scholarships in Brazil - Scientific Initiation
Effective date (Start): June 01, 2015
Effective date (End): January 31, 2016
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
Principal Investigator:João Paulo Papa
Grantee:Nathalia Queiroz Ascenção
Home Institution: Faculdade de Ciências (FC). Universidade Estadual Paulista (UNESP). Campus de Bauru. Bauru , SP, Brazil

Abstract

Deep learning techniques have been widely investigated by the machine learning community in the last years, mainly due to their suitable results in crucial applications, such as face recognition and speech identification, as well as object classification. One of the most used techniques is the Restricted Boltzmann Machine (RBM), which can be defined, essentially, as being stochastic neural networks that aim at estimating the weights between different layers using Markov chain (MC) sampling techniques. Currently, a considerable number of works have focused on studying such sampling methods, since the efficiency and effectiveness of an RBM is strongly related to them. Therefore, this proposal aims at investigating three approaches for MC sampling: Contrastive Divergence, Persistent Contrastive Divergence and Fast Persistent Contrastive Divergence. Additionally, we aim at comparing them in different scenarios concerning image classification tasks.