Scholarship 17/03940-5 - Análise de imagens, Aprendizado computacional - BV FAPESP
Advanced search
Start date
Betweenand

Interactive Learning of Visual Dictionaries Applied to Image Classification

Grant number: 17/03940-5
Support Opportunities:Scholarships in Brazil - Doctorate
Start date: August 01, 2017
End date: February 29, 2020
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
Agreement: Coordination of Improvement of Higher Education Personnel (CAPES)
Principal Investigator:Alexandre Xavier Falcão
Grantee:César Christian Castelo Fernández
Host Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
Associated research grant:14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?, AP.TEM

Abstract

Deep learning techniques have become very popular in the design of image descriptors and pattern classifiers as a single pipeline. A well-known drawback in those techniques, however, is the need of large training sets with pre-annotated samples. Unfortunately, in several applications of the Sciences and Engineering, it is difficult to count on specialists to pre-annotate large training sets, especially when the annotation requires interactive image segmentation (which is the case when samples are image objects). Even the manual specification of regions of interest around objects might be difficult when the number of required samples is high, or when the image is volumetric. This makes important the investigation of techniques that can learn from a small number of labeled samples. Bag of Visual Words (BoVW) is an example of success in unsupervised feature learning. By detecting points and local image features from a set of unlabeled training images, a dictionary of visual words can be constructed with the most representative features and an effective image descriptor can be obtained by matching the local image features of a given new image and the visual words in the dictionary. By training a supervised classifier based on those image descriptors, it is possible to assign labels to new images. In this project, we aim at revisiting BoVW for the design of image descriptors from a small number of labeled samples. Given the success of BoVW as an unsupervised feature learning technique, we believe that the knowledge of the samples' labels can considerably improve its performance. Therefore, we propose to investigate ways of exploiting the label information in the design of visual dictionaries. This allows us to increase the number of labeled samples by active learning, as the pattern classifier based on the BoVW image descriptor improves along learning iterations. We believe that the performance of the resulting classifier will be satisfactory, much before the labeled training set can be considered large, which would be a tremendous saving of time and effort in image annotation for the specialists. We are also interested in evaluating the performance of the resulting BoVW-based image classifier with the image classification based on deep learning, using the same increased training sets. The idea is to discover a minimum number of labeled samples required for effective deep learning. Of course, those issues can lead to different answers depending on the application. We intend to focus on image datasets from a major project associated with the diagnosis of intestinal parasites. (AU)

News published in Agência FAPESP Newsletter about the scholarship:
More itemsLess items
Articles published in other media outlets ( ):
More itemsLess items
VEICULO: TITULO (DATA)
VEICULO: TITULO (DATA)

Scientific publications (4)
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
SOUSA, AZAEL MELO; CASTELO-FERNANDEZ, CESAR; OSAKU, DANIEL; BAGATIN, ERICSON; REIS, FABIANO; FALCAO, ALEXANDRE X.; IEEE. An Approach for Asbestos-related Pleural Plaque Detection. 42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, v. N/A, p. 4-pg., . (14/12236-1, 17/03940-5)
SOUSA, AZAEL M.; REIS, FABIANO; ZERBINI, RACHEL; COMBA, JOAO L. D.; FALCAO, ALEXANDRE X.; IEEE. CNN Filter Learning from Drawn Markers for the Detection of Suggestive Signs of COVID-19 in CT Images. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), v. N/A, p. 4-pg., . (14/12236-1, 17/03940-5)
CULQUICONDOR, ALDO; BALDASSIN, ALEXANDRO; CASTELO-FERNANDEZ, CESAR; DE CARVALHO, JOAO P. L.; PAPA, JOAO PAULO. An efficient parallel implementation for training supervised optimum-path forest classifiers. Neurocomputing, v. 393, p. 259-268, . (14/16250-9, 14/12236-1, 13/07375-0, 16/19403-6, 17/03940-5)
CASTELO-FERNANDEZ, CESAR; FALCAO, ALEXANDRE X.; VENTO, M; PERCANNELLA, G. Learning Visual Dictionaries from Class-Specific Superpixel Segmentation. COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2019, PT I, v. 11678, p. 12-pg., . (14/12236-1, 17/03940-5)