On the influence of Markovian models for restricted Boltzmann machines training

• Grant number: 15/00478-3
• Support Opportunities: Scholarships in Brazil - Scientific Initiation
• Start date: June 01, 2015
• End date: January 31, 2016
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: João Paulo Papa
• Grantee: Nathalia Queiroz Ascenção
• Host Institution: Faculdade de Ciências (FC). Universidade Estadual Paulista (UNESP). Campus de Bauru. Bauru , SP, Brazil

Abstract

Deep learning techniques have been widely investigated by the machine learning community in the last years, mainly due to their suitable results in crucial applications, such as face recognition and speech identification, as well as object classification. One of the most used techniques is the Restricted Boltzmann Machine (RBM), which can be defined, essentially, as being stochastic neural networks that aim at estimating the weights between different layers using Markov chain (MC) sampling techniques. Currently, a considerable number of works have focused on studying such sampling methods, since the efficiency and effectiveness of an RBM is strongly related to them. Therefore, this proposal aims at investigating three approaches for MC sampling: Contrastive Divergence, Persistent Contrastive Divergence and Fast Persistent Contrastive Divergence. Additionally, we aim at comparing them in different scenarios concerning image classification tasks.