Fine-tuning prototypical neural networks using metaheurístics

• Grant number: 20/16092-5
• Support type: Scholarships in Brazil - Scientific Initiation
• Effective date (Start): March 01, 2021
• Effective date (End): February 28, 2022
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal researcher: João Paulo Papa
• Grantee: Giovani Candido
• Home Institution: Faculdade de Ciências (FC). Universidade Estadual Paulista (UNESP). Campus de Bauru. Bauru , SP, Brazil
• Associated research grant: 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?, AP.TEM

Abstract

Supervised learning upon small datasets, aka few-shot learning, aims at dealing with situations in which only a few samples are available for training purposes. Among the primary applications, one shall refer to those who use medical records since samples positive for some illnesses are sometimes not straightforward to obtain. Prototypical Neural Networks arose as one of the most widely employed techniques for such a purpose, which maps training samples from each class onto another feature space based on prototype samples. Such examples correspond to the average of the samples available from a given category. The main shortcoming of such an approach, although simple and effective, is not to consider the fact that samples may contribute differently to the computation of the prototypes. This proposal aims to model the task of learning the importance of each training sample when estimating the prototypes as a metaheuristic optimization problem; specifically, we are interested in evolutionary techniques. The approach to be proposed will be evaluated in two main tasks: (I) general-purpose datasets and (II) endoscopy images. Besides, the proposal also intends to hold an internship at the University of the Basque Country, Spain.