Multi-label annotation of natural image databases with minimal supervision

• Grant number: 12/24121-9
• Support Opportunities: Scholarships in Brazil - Doctorate (Direct)
• Start date: June 01, 2013
• End date: August 31, 2014
• Field of knowledge: Physical Sciences and Mathematics - Computer Science
• Principal Investigator: Alexandre Xavier Falcão
• Grantee: Paulo Eduardo Rauber
• Host Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil

Abstract

The growth of video and image databases has made automatic image annotation very important for content-based image retrieval. Content-based retrieval is a current research topic, and has been used for retrieval of several image modalities (e.g., photography, videos, tomographies, remote sensing images). The objective of this project is to study and develop techniques for automatic annotation of natural images from a database -- i.e., associating a label (keyword) to each object of interest in a given image. A promising methodology consists on automatically segmenting the image, extracting features from its regions and annotating each region using a pattern classifier. There are several challenges to be investigated in each of those steps: segmentation techniques, learning feature descriptors (deep learning, convolutional networks), active learning applied to pattern classifiers, and post-processing techniques to keep consistent image annotations between connected regions. We are particularly interested in selecting training samples (regions) using active learning techniques, intending to enhance the accuracy of the annotations and minimize the effort employed by the user to annotate the training set of the classifier. We will also investigate techniques for learning region descriptors for natural images and segmentation post-processing. The results will be validated using image datasets for testing already established in the literature. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

RAUBER, PAULO E.; FALCAO, ALEXANDRE X.; TELEA, ALEXANDRU C.. Projections as visual aids for classification system design. INFORMATION VISUALIZATION, v. 17, n. 4, p. 282-305, OCT 2018. (14/12236-1, 12/24121-9)

Academic Publications

(References retrieved automatically from State of São Paulo Research Institutions)

RAUBER, Paulo Eduardo. Análise visual aplicada à análise de imagens. 2017. Doctoral Thesis - Universidade Estadual de Campinas (UNICAMP). Instituto de Computação Campinas, SP.