Research Grants 16/19403-6 - Redes neurais (computação), Aprendizado computacional - BV FAPESP
Advanced search
Start date
Betweenand

Energy-based learning models and their applications

Grant number: 16/19403-6
Support Opportunities:Regular Research Grants
Start date: August 01, 2017
End date: July 31, 2019
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
Principal Investigator:João Paulo Papa
Grantee:João Paulo Papa
Host Institution: Faculdade de Ciências (FC). Universidade Estadual Paulista (UNESP). Campus de Bauru. Bauru , SP, Brazil
Associated researchers:Aparecido Nilceu Marana ; Clayton Reginaldo Pereira ; Dinesh Kant Kumar ; Gustavo Kunde Rohde

Abstract

Energy-based models have been employed in a number of research areas, since they belong to a broad framework that comprises both probabilistic and non-probabilistic techniques. Among the most used techniques from this context, one can refer to the Restricted Boltzmann Machines and their deep learning-driven variants: Deep Belief Nets and Deep Boltzmann Machines. Such models also have shortcomings that will be considered in this proposal, such as the automatic optimization of their parameters, how to enhance the effectiveness of the learning process by means of sampling in Markov chains, as well as how to obtain a better regularization process based on different temperatures and pruning neurons. The proposal has two main lines of research: (i) applications and (ii) theoretic work. In the former, we will look for applications that have not evaluated the aforementioned energy-based models to date, mainly the ones related to biometric- and medicine-oriented data. In regard to the theoretic research, we expect to contribute with different models for sampling in Markov chains aiming at enhancing the inference step of these models. The proposal also considers national and foreign researchers, as well as undergraduate and graduate students. Since there are a very few research groups in Brazil that work in the same context of this proposal, we believe we can make difference and help the scientific community with works related to energy-based learning. (AU)

Articles published in Agência FAPESP Newsletter about the research grant:
More itemsLess items
Articles published in other media outlets ( ):
More itemsLess items
VEICULO: TITULO (DATA)
VEICULO: TITULO (DATA)

Scientific publications (51)
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
PASSOS, LEANDRO APARECIDO; PAPA, JOAO PAULO. A metaheuristic-driven approach to fine-tune Deep Boltzmann Machines. APPLIED SOFT COMPUTING, v. 97, n. B, . (13/07375-0, 14/12236-1, 16/19403-6)
RIBEIRO, LUIZ C. F.; AFONSO, LUIS C. S.; COLOMBO, DANILO; GUILHERME, IVAN R.; PAPA, JOAO P.. Evolving Neural Conditional Random Fields for drilling report classification. JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, v. 187, . (14/12236-1, 13/07375-0, 16/19403-6)
PAPA, JOAO P.; ROSA, GUSTAVO H.; DE SOUZA, ANDRE N.; AFONSO, LUIS C. S.. Feature selection through binary brain storm optimization. COMPUTERS & ELECTRICAL ENGINEERING, v. 72, p. 468-481, . (13/07375-0, 17/02286-0, 16/19403-6, 14/12236-1, 17/22905-6, 13/08645-0)
ALYASSERI, ZAID ABDI ALKAREEM; KHADER, AHAMAD TAJUDIN; AL-BETAR, MOHAMMED AZMI; PAPA, JOAO P.; ALOMARI, OSAMA AHMAD. EEG Feature Extraction for Person Identification Using Wavelet Decomposition and Multi-Objective Flower Pollination Algorithm. IEEE ACCESS, v. 6, p. 76007-76024, . (13/07375-0, 14/12236-1, 16/19403-6)
FERNANDES, SILAS E. N.; PEREIRA, DANILLO R.; RAMOS, CAIO C. O.; SOUZA, ANDRE N.; GASTALDELLO, DANILO S.; PAPA, JOAO P.. A Probabilistic Optimum-Path Forest Classifier for Non-Technical Losses Detection. IEEE TRANSACTIONS ON SMART GRID, v. 10, n. 3, p. 3226-3235, . (13/07375-0, 14/16250-9, 17/02286-0, 16/19403-6, 14/12236-1)
PASSOS, JR., LEANDRO APARECIDO; PAPA, JOAO PAULO. Temperature-Based Deep Boltzmann Machines. NEURAL PROCESSING LETTERS, v. 48, n. 1, p. 95-107, . (14/16250-9, 14/12236-1, 16/19403-6)
AFONSO, LUIS C. S.; ROSA, GUSTAVO H.; PEREIRA, CLAYTON R.; WEBER, SILKE A. T.; HOOK, CHRISTIAN; ALBUQUERQUE, VICTOR HUGO C.; PAPA, JOAO P.. A recurrence plot-based approach for Parkinson's disease identification. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, v. 94, p. 282-292, . (14/12236-1, 13/07375-0, 16/19403-6)
GUIMARAES, RANIERE ROCHA; PASSOS JR, LEANDRO A.; HOLANDA FILHO, RAIMIR; DE ALBUQUERQUE, VICTOR HUGO C.; RODRIGUES, JOEL J. P. C.; KOMAROV, MIKHAIL M.; PAPA, JOAO PAULO. Intelligent Network Security Monitoring Based on Optimum-Path Forest Clustering. IEEE NETWORK, v. 33, n. 2, p. 126-131, . (13/07375-0, 14/16250-9, 14/12236-1, 16/19403-6)
PAPA, JOAO PAULO; ROSA, GUSTAVO HENRIQUE; PAPA, LUCIENE PATRICI. A binary-constrained Geometric Semantic Genetic Programming for feature selection purposes. PATTERN RECOGNITION LETTERS, v. 100, p. 59-66, . (13/07375-0, 14/16250-9, 16/19403-6, 10/15566-1, 14/12236-1, 15/25739-4)
SANTANA, MARCOS C. S.; PASSOS, JR., LEANDRO APARECIDO; MOREIRA, THIERRY P.; COLOMBO, DANILO; DE ALBUQUERQUE, VICTOR HUGO C.; PAPA, JOAO PAULO. A Novel Siamese-Based Approach for Scene Change Detection With Applications to Obstructed Routes in Hazardous Environments. IEEE INTELLIGENT SYSTEMS, v. 35, n. 1, p. 44-53, . (14/12236-1, 13/07375-0, 17/25908-6, 16/19403-6)
AMORIM, WILLIAN PARAGUASSU; ROSA, GUSTAVO HENRIQUE; THOMAZELLA, ROGERIO; COGO CASTANHO, JOSE EDUARDO; LOFRANO DOTTO, FABIO ROMANO; RODRIGUES JUNIOR, OSWALDO PONS; MARANA, APARECIDO NILCEU; PAPA, JOAO PAULO. Semi-supervised learning with connectivity-driven convolutional neural networks. PATTERN RECOGNITION LETTERS, v. 128, p. 16-22, . (14/12236-1, 13/07375-0, 15/25739-4, 16/19403-6)
SOUZA, LUIS A., JR.; AFONSO, LUIS C. S.; PALM, CHRISTOPH; PAPA, JOAO P.; IEEE. Barrett's Esophagus Identification Using Optimum-Path Forest. 2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 7-pg., . (16/19403-6, 14/12236-1)
COLOMBO, DANILO; ALVES LIMA, GILSON BRITO; PEREIRA, DANILLO ROBERTO; PAPA, JOAO P.. Regression-based finite element machines for reliability modeling of downhole safety valves. RELIABILITY ENGINEERING & SYSTEM SAFETY, v. 198, . (14/12236-1, 13/07375-0, 16/19403-6)
PIRES, RAFAEL G.; SANTOS, DANIEL S.; SOUZA, GUSTAVO B.; LEVADA, ALEXANDRE L. M.; PAPA, JOAO PAULO; TETKO, IV; KURKOVA, V; KARPOV, P; THEIS, F. A Sparse Filtering-Based Approach for Non-blind Deep Image Denoising. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, v. 11731, p. 12-pg., . (14/16250-9, 14/12236-1, 16/19403-6, 18/21934-5)
RODRIGUES, DOUGLAS; DE ALBUQUERQUE, VICTOR HUGO C.; PAPA, JOAO PAULO. A multi-objective artificial butterfly optimization approach for feature selection. APPLIED SOFT COMPUTING, v. 94, . (14/12236-1, 14/16250-9, 17/02286-0, 16/19403-6)
DE SOUZA, GUSTAVO BOTELHO; PAPA, JOAO PAULO; MARANA, APARECIDO NILCEU; IEEE. On the Learning of Deep Local Features for Robust Face Spoofing Detection. PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 8-pg., . (14/12236-1, 17/05522-6, 16/19403-6)
PASSOS, L. A.; PAPA, J. P.; IEEE. Fine-Tuning Infinity Restricted Boltzmann Machines. 2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 8-pg., . (14/12236-1, 16/19403-6)
DA SILVA CIESLAK, LUIZ FERNANDO; PONTARA DA COSTA, KELTON AUGUSTO; PAPA, JOAO PAULO; IEEE. Seam Carving Detection Using Convolutional Neural Networks. 2018 IEEE 12TH INTERNATIONAL SYMPOSIUM ON APPLIED COMPUTATIONAL INTELLIGENCE AND INFORMATICS (SACI), v. N/A, p. 5-pg., . (13/07375-0, 14/12236-1, 16/25687-7, 16/19403-6)
AFONSO, LUIS C. S.; PEDRONETTE, DANIEL C. G.; DE SOUZA, ANDRE N.; PAPA, JOAO P.; IEEE. Improving Optimum-Path Forest Classification Using Unsupervised Manifold Learning. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), v. N/A, p. 6-pg., . (14/12236-1, 13/07375-0, 17/22905-6, 13/08645-0, 17/02286-0, 16/19403-6)
FELIX RIBEIRO, LUIZ CARLOS; PAPA, JOAO PAULO; IEEE. Unsupervised Dialogue Act Classification with Optimum-Path Forest. PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 8-pg., . (13/07375-0, 14/12236-1, 14/16250-9, 16/19403-6)
AFONSO, LUIS C. S.; COLOMBO, DANILO; PEREIRA, CLAYTON R.; COSTA, KELTON A. P.; PAPA, JOAO P.; IEEE. Multiple-Instance Learning through Optimum-Path Forest. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), v. N/A, p. 7-pg., . (13/07375-0, 17/22905-6, 16/19403-6)
PASSOS, LEANDRO APARECIDO; PAPA, JOAO PAULO. A metaheuristic-driven approach to fine-tune Deep Boltzmann Machines. APPLIED SOFT COMPUTING, v. 97, p. 12-pg., . (13/07375-0, 16/19403-6, 14/12236-1)
DE SOUZA, RENATO WILLIAM R.; DE OLIVEIRA, JOAO VITOR CHAVES; PASSOS, JR., LEANDRO A.; DING, WEIPING; PAPA, JOAO P.; DE ALBUQUERQUE, VICTOR HUGO C.. A Novel Approach for Optimum-Path Forest Classification Using Fuzzy Logic. IEEE TRANSACTIONS ON FUZZY SYSTEMS, v. 28, n. 12, p. 3076-3086, . (13/07375-0, 17/25908-6, 18/21934-5, 16/19403-6, 14/12236-1)
BIAGGI, LUCAS; PAPA, JOAO P.; COSTA, KELTON A. P.; PEREIRA, DANILLO R.; PASSOS, LEANDRO A.; IEEE. FEMa-FS: Finite Element Machines for Feature Selection. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), v. N/A, p. 8-pg., . (21/05516-1, 17/22905-6, 13/07375-0, 16/19403-6, 14/12236-1)
SOUSA, G. J.; PEDRONETTE, D. C. G.; BALDASSIN, A.; PRIVATTO, P. I. M.; GASETA, M.; GUILHERME, I. R.; COLOMBO CENPES, D.; AFONSO, L. C. S.; PAPA, J. P.; IEEE. Pattern Analysis in Drilling Reports using Optimum-Path Forest. 2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), v. N/A, p. 8-pg., . (13/07375-0, 16/19403-6, 14/12236-1)
DE SOUZA, LUIS A., JR.; EBIGBO, ALANNA; PROBST, ANDREAS; MESSMANN, HELMUT; PAPA, JOAO P.; MENDEL, ROBERT; PALM, CHRISTOPH; IEEE. Barrett's Esophagus Identification Using Color Co-occurrence Matrices. PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 8-pg., . (13/07375-0, 16/19403-6, 14/12236-1)
PASSOS, LEANDRO A.; RODRIGUES, DOUGLAS R.; PAPA, JOAO P.; IEEE. Fine Tuning Deep Boltzmann Machines Through Meta-Heuristic Approaches. 2018 IEEE 12TH INTERNATIONAL SYMPOSIUM ON APPLIED COMPUTATIONAL INTELLIGENCE AND INFORMATICS (SACI), v. N/A, p. 6-pg., . (14/12236-1, 16/19403-6, 13/07375-0)
DA COSTA, KELTON A. P.; PAPA, JOAO P.; PASSOS, LEANDRO A.; COLOMBO, DANILO; DEL SER, JAVIER; MUHAMMAD, KHAN; DE ALBUQUERQUE, VICTOR HUGO C.. A critical literature survey and prospects on tampering and anomaly detection in image data. APPLIED SOFT COMPUTING, v. 97, p. 15-pg., . (16/19403-6, 14/12236-1, 17/22905-6, 13/07375-0)
THOMAZELLA, R.; CASTANHO, J. E.; DOTTO, F. R. L.; RODRIGUES JUNIOR, O. P.; ROSA, G. H.; MARANA, A. N.; PAPA, J. P.; IEEE. ENVIRONMENTAL MONITORING USING DRONE IMAGES AND CONVOLUTIONAL NEURAL NETWORKS. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, v. N/A, p. 4-pg., . (13/07375-0, 15/25739-4, 14/12236-1, 16/19403-6)
PEREIRA, D. R.; PAPA, J. P.; PAPA, L. P.; PISANI, R. J.; IEEE. LAND-USE CLASSIFICATION USING FINITE ELEMENT MACHINES. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, v. N/A, p. 4-pg., . (13/07375-0, 16/19403-6, 14/12236-1)
DA COSTA, KELTON A. P.; PAPA, JOAO P.; PASSOS, LEANDRO A.; COLOMBO, DANILO; DEL SER, JAVIER; MUHAMMAD, KHAN; DE ALBUQUERQUE, VICTOR HUGO C.. A critical literature survey and prospects on tampering and anomaly detection in image data. APPLIED SOFT COMPUTING, v. 97, n. B, . (16/19403-6, 14/12236-1, 13/07375-0, 17/22905-6)
RODRIGUES, DOUGLAS; SOUZA, ANDRE NUNES; PAPA, JOAO PAULO; IEEE. Pruning Optimum-Path Forest Classifiers Using Multi-Objective Optimization. 2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 7-pg., . (14/12236-1, 16/19403-6)
SANTOS, DANIEL F. S.; PIRES, RAFAEL G.; COLOMBO, DANILO; PAPA, JOAO P.; IEEE. Video Segmentation Learning Using Cascade Residual Convolutional Neural Network. 2019 32ND SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 7-pg., . (14/12236-1, 16/19403-6, 13/07375-0)
AMORIM, WILLIAN PARAGUASSU; TETILA, EVERTON CASTELAO; PISTORI, HEMERSON; PAPA, JOAO PAULO. Semi-supervised learning with convolutional neural networks for UAV images automatic recognition. COMPUTERS AND ELECTRONICS IN AGRICULTURE, v. 164, . (14/12236-1, 13/07375-0, 15/25739-4, 16/19403-6)
NACHIF FERNANDES, SILAS EVANDRO; PAPA, JOAO PAULO. Improving optimum-path forest learning using bag-of-classifiers and confidence measures. PATTERN ANALYSIS AND APPLICATIONS, v. 22, n. 2, p. 703-716, . (13/07375-0, 14/16250-9, 14/12236-1, 16/19403-6)
DA COSTA, KELTON A. P.; PAPA, JOAO P.; LISBOA, CELSO O.; MUNOZ, ROBERTO; DE ALBUQUERQUE, VICTOR HUGO C.. Internet of Things: A survey on machine learning-based intrusion detection approaches. Computer Networks, v. 151, p. 147-157, . (14/12236-1, 17/22905-6, 16/19403-6, 13/07375-0)
PEREIRA, CLAYTON R.; PEREIRA, DANILO R.; WEBER, SILKE A. T.; HOOK, CHRISTIAN; DE ALBUQUERQUE, VICTOR HUGO C.; PAPA, JOAO P.. A survey on computer-assisted Parkinson's Disease diagnosis. ARTIFICIAL INTELLIGENCE IN MEDICINE, v. 95, p. 48-63, . (13/07375-0, 14/16250-9, 14/12236-1, 16/19403-6)
DE SOUZA JR, LUIS A.; MENDEL, ROBERT; STRASSER, SOPHIA; EBIGBO, ALANNA; PROBST, ANDREAS; MESSMANN, HELMUT; PAPA, JOAO P.; PALM, CHRISTOPH. Convolutional Neural Networks for the evaluation of cancer in Barrett's esophagus: Explainable AI to lighten up the black-box. COMPUTERS IN BIOLOGY AND MEDICINE, v. 135, . (17/04847-9, 16/19403-6, 14/12236-1, 13/07375-0, 19/08605-5)
ALYASSERI, ZAID ABDI ALKAREEM; KHADER, AHAMAD TAJUDIN; AL-BETAR, MOHAMMED AZMI; PAPA, JOAO P.; ALOMARI, OSAMA AHMAD; IEEE. EEG-based Person Authentication Using Multi-objective Flower Pollination Algorithm. 2018 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), v. N/A, p. 8-pg., . (13/07375-0, 16/19403-6, 14/12236-1)
CULQUICONDOR, ALDO; BALDASSIN, ALEXANDRO; CASTELO-FERNANDEZ, CESAR; DE CARVALHO, JOAO P. L.; PAPA, JOAO PAULO. An efficient parallel implementation for training supervised optimum-path forest classifiers. Neurocomputing, v. 393, p. 259-268, . (14/16250-9, 14/12236-1, 13/07375-0, 16/19403-6, 17/03940-5)
PEREIRA, DANILLO ROBERTO; PAPA, JOAO PAULO; ROSALIN SARAIVA, GUSTAVO FRANCISCO; SOUZA, GUSTAVO MAIA. Automatic classification of plant electrophysiological responses to environmental stimuli using machine learning and interval arithmetic. COMPUTERS AND ELECTRONICS IN AGRICULTURE, v. 145, p. 35-42, . (14/12236-1, 13/07375-0, 16/19403-6, 14/16250-9)
IWASHITA, ADRIANA SAYURI; PAPA, JOAO PAULO. An Overview on Concepts Drift Learning. IEEE ACCESS, v. 7, p. 1532-1547, . (14/16250-9, 14/12236-1, 13/07375-0, 16/19403-6)
SOUZA, LUIZ; OLIVEIRA, LUCIANO; PAMPLONA, MAURICIO; PAPA, JOAO. How far did we get in face spoofing detection?. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, v. 72, p. 368-381, . (13/07375-0, 14/12236-1, 16/19403-6)
DE SOUZA JR, LUIS A.; PALM, CHRISTOPH; MENDEL, ROBERT; HOOK, CHRISTIAN; EBIGBO, ALANNA; PROBST, ANDREAS; MESSMANN, HELMUT; WEBER, SILKE; PAPA, JOAO P.. A survey on Barrett's esophagus analysis using machine learning. COMPUTERS IN BIOLOGY AND MEDICINE, v. 96, p. 203-213, . (13/07375-0, 14/12236-1, 16/19403-6)
KHOJASTEH, PARHAM; PASSOS JUNIOR, LEANDRO APARECIDO; CARVALHO, TIAGO; REZENDE, EDMAR; ALIAHMAD, BEHZAD; PAPA, JOAO PAULO; KUMAR, DINESH KANT. Exudate detection in fundus images using deeply-learnable features. COMPUTERS IN BIOLOGY AND MEDICINE, v. 104, p. 62-69, . (16/50022-9, 13/07375-0, 14/12236-1, 16/19403-6)
PEREIRA, CLAYTON R.; PEREIRA, DANILO R.; ROSA, GUSTAVO H.; ALBUQUERQUE, VICTOR H. C.; WEBER, SILKE A. T.; HOOK, CHRISTIAN; PAPA, JOAO P.. Handwritten dynamics dynamics assessment through convolutional neural networks: An application to Parkinson's disease identification. ARTIFICIAL INTELLIGENCE IN MEDICINE, v. 87, p. 67-77, . (13/07375-0, 14/16250-9, 16/19403-6, 10/15566-1, 14/12236-1, 15/25739-4)
AFONSO, LUIS C. S.; PEREIRA, CLAYTON R.; WEBER, SILKE A. T.; HOOK, CHRISTIAN; PAPA, JOAO P.; IEEE. Parkinson's Disease Identification Through Deep Optimum-Path Forest Clustering. 2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 7-pg., . (14/12236-1, 16/19403-6)
DE ROSA, GUSTAVO H.; PAPA, JOAO P.; YANG, XIN-SHE. A nature-inspired feature selection approach based on hypercomplex information. APPLIED SOFT COMPUTING, v. 94, . (13/07375-0, 16/19403-6, 14/12236-1, 17/25908-6, 17/02286-0, 19/02205-5)
PIRES, RAFAEL; LEVADA, ALEXANDRE L. M.; SOUZA, GUSTAVO B.; PEREIRA, LUIS A. M.; SANTOS, DANIEL F. S.; PAPA, JOAO P.; IEEE. A Robust Restricted Boltzmann Machine for Binary Image Denoising. 2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 7-pg., . (14/12236-1, 16/19403-6, 15/09169-3)
ALYASSERI, ZAID ABDI ALKAREEM; KHADER, AHAMAD TAJUDIN; AL-BETAR, MOHAMMED AZMI; PAPA, JOAO P.; ALOMARI, OSAMA AHMAD; MAKHADME, SHARIF NASER; IEEE. An efficient optimization technique of EEG decomposition for user authentication system. 2018 2ND INTERNATIONAL CONFERENCE ON BIOSIGNAL ANALYSIS, PROCESSING AND SYSTEMS (ICBAPS 2018), v. N/A, p. 6-pg., . (13/07375-0, 16/19403-6, 14/12236-1)