Advanced search
Start date

Multi-label annotation of natural image databases with minimal supervision

Grant number: 12/24121-9
Support Opportunities:Scholarships in Brazil - Doctorate (Direct)
Effective date (Start): June 01, 2013
Effective date (End): August 31, 2014
Field of knowledge:Physical Sciences and Mathematics - Computer Science
Principal Investigator:Alexandre Xavier Falcão
Grantee:Paulo Eduardo Rauber
Host Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil


The growth of video and image databases has made automatic image annotation very important for content-based image retrieval. Content-based retrieval is a current research topic, and has been used for retrieval of several image modalities (e.g., photography, videos, tomographies, remote sensing images). The objective of this project is to study and develop techniques for automatic annotation of natural images from a database -- i.e., associating a label (keyword) to each object of interest in a given image. A promising methodology consists on automatically segmenting the image, extracting features from its regions and annotating each region using a pattern classifier. There are several challenges to be investigated in each of those steps: segmentation techniques, learning feature descriptors (deep learning, convolutional networks), active learning applied to pattern classifiers, and post-processing techniques to keep consistent image annotations between connected regions. We are particularly interested in selecting training samples (regions) using active learning techniques, intending to enhance the accuracy of the annotations and minimize the effort employed by the user to annotate the training set of the classifier. We will also investigate techniques for learning region descriptors for natural images and segmentation post-processing. The results will be validated using image datasets for testing already established in the literature. (AU)

News published in Agência FAPESP Newsletter about the scholarship:
Articles published in other media outlets (0 total):
More itemsLess items

Scientific publications
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
RAUBER, PAULO E.; FALCAO, ALEXANDRE X.; TELEA, ALEXANDRU C.. Projections as visual aids for classification system design. INFORMATION VISUALIZATION, v. 17, n. 4, p. 282-305, . (14/12236-1, 12/24121-9)
Academic Publications
(References retrieved automatically from State of São Paulo Research Institutions)
RAUBER, Paulo Eduardo. Análise visual aplicada à análise de imagens. 2017. Doctoral Thesis - Universidade Estadual de Campinas (UNICAMP). Instituto de Computação Campinas, SP.

Please report errors in scientific publications list using this form.