Advanced search
Start date
Betweenand

Interactive Annotation of Remote Sensing Images

Grant number: 16/14760-5
Support Opportunities:Scholarships in Brazil - Doctorate
Start date: November 01, 2016
End date: June 30, 2019
Field of knowledge:Physical Sciences and Mathematics - Computer Science
Principal Investigator:Alexandre Xavier Falcão
Grantee:John Edgar Vargas Muñoz
Host Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
Associated scholarship(s):17/10086-0 - Interactive rural building detection and delineation using remote sensing images, BE.EP.DR

Abstract

Several remote sensing image classification methods have been proposed to generate thematic maps of land cover and urban areas. However, photo-interpreters still manually annotate remote sensing images - an exhaustive and error-prone task, especially when it relies on some artificial color image composition with hardly distinguishable classes. In land cover mappings, the problem not rare makes necessary to visit the geographical location for correct image annotation. In this context, the quality of the selected image features and training samples is crucial to minimize the user effort and time in image annotation. The use of regions as samples and active learning techniques can mitigate the problem by reducing the numbers of training samples and iterations for the expert's label supervision. However, the development of active learning methods often relies on the simulation of the expert's actions using pre-annotated data sets. Such practice ignores possible annotation errors and disregard the user as part of the learning loop. Moreover, the methods usually ignore that non-interest regions in the image must also be treated. We propose to investigate active learning methods that do not suffer from those shortcomings in order to develop a more realistic framework for remote sensing image annotation. The proposal relies on effective prior superpixel segmentation, feature extraction, and data organization in order to facilitate the active learning loop, where the apprentice classifier must select the most effective training samples for its learning process. For development and validation, we will use natural color images to facilitate label supervision with the expert being part of the active learning loop. The simulation of the expert's actions on color composition images, pre-annotated by specialists, will also be considered for a more extensive evaluation.

News published in Agência FAPESP Newsletter about the scholarship:
More itemsLess items
Articles published in other media outlets ( ):
More itemsLess items
VEICULO: TITULO (DATA)
VEICULO: TITULO (DATA)

Scientific publications (11)
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
VARGAS MUNOZ, JOHN E.; TUIA, DEVIS; FALCAO, ALEXANDRE X.. Deploying machine learning to assist digital humanitarians: making image annotation in OpenStreetMap more efficient. INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, v. 35, n. 9, p. 1725-1745, . (14/12236-1, 16/14760-5)
VARGAS-MUNOZ, JOHN E.; LOBRY, SYLVAIN; FALCAO, ALEXANDRE X.; TUIA, DEVIS. Correcting rural building annotations in OpenStreetMap using convolutional neural networks. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, v. 147, p. 283-293, . (14/12236-1, 16/14760-5, 17/10086-0)
VARGAS-MUNOZ, JOHN E.; ZHOU, PING; FALCAO, ALEXANDRE X.; TUIA, DEVIS; IEEE. INTERACTIVE COCONUT TREE ANNOTATION USING FEATURE SPACE PROJECTIONS. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), v. N/A, p. 4-pg., . (16/14760-5, 14/12236-1)
VARGAS-MUNOZ, JOHN E.; SRIVASTAVA, SHIVANGI; TUIA, DEVIS; FALCAO, ALEXANDRE X.. A New Benchmark Based on Recent Advances in Multispectral Pansharpening: Revisiting Pansharpening With Classical and Emerging Pansharpening Methods. IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, v. 9, n. 1, p. 184-199, . (14/12236-1, 16/14760-5)
VARGAS MUNOZ, JOHN E.; TUIA, DEVIS; FALCAO, ALEXANDRE X.. Deploying machine learning to assist digital humanitarians: making image annotation in OpenStreetMap more efficient. INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, . (16/14760-5, 14/12236-1)
VARGAS-MUNOZ, JOHN E.; MARCOS, DIEGO; LOBRY, SYLVAIN; DOS SANTOS, JEFERSSON A.; FALCAO, ALEXANDRE X.; TUIA, DEVIS; IEEE. CORRECTING MISALIGNED RURAL BUILDING ANNOTATIONS IN OPEN STREET MAP USING CONVOLUTIONAL NEURAL NETWORKS EVIDENCE. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, v. N/A, p. 4-pg., . (16/14760-5, 14/12236-1, 17/10086-0)
VARGAS-MUNOZ, JOHN E.; SRIVASTAVA, SHIVANGI; TUIA, DEVIS; FALCAO, ALEXANDRE X.. OpenStreetMap: Challenges and Opportunities in Machine Learning and Remote Sensing. IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, v. 9, n. 1, p. 16-pg., . (16/14760-5, 14/12236-1)
SRIVASTAVA, SHIVANGI; VARGAS-MUNOZ, JOHN E.; TUIA, DEVIS. Understanding urban landuse from the above and ground perspectives: A deep learning, multimodal solution. REMOTE SENSING OF ENVIRONMENT, v. 228, p. 129-143, . (16/14760-5, 17/10086-0)
VARGAS-MUNOZ, JOHN E.; CHOWDHURY, ANANDA S.; ALEXANDRE, EDUARDO B.; GALVAO, FELIPE L.; VECHIATTO MIRANDA, PAULO A.; FALCAO, ALEXANDRE X.. An Iterative Spanning Forest Framework for Superpixel Segmentation. IEEE Transactions on Image Processing, v. 28, n. 7, p. 3477-3489, . (16/14760-5, 14/12236-1, 15/01186-6, 14/50937-1)
FARFAN-ESCOBEDO, JEANFRANCO D.; ENCISO-RODAS, LAURO; VARGAS-MUNOZ, JOHN E.; IEEE PERU SECT. Towards accurate building recognition using convolutional neural networks. PROCEEDINGS OF THE 2017 IEEE XXIV INTERNATIONAL CONFERENCE ON ELECTRONICS, ELECTRICAL ENGINEERING AND COMPUTING (INTERCON), v. N/A, p. 4-pg., . (16/14760-5)
VARGAS-MUNOZ, JOHN E.; TUIA, DEVIS; DOS SANTOS, JEFERSSON A.; FALCAO, ALEXANDRE X.; IEEE. POST CLASSIFICATION SMOOTHING IN SUB-DECIMETER RESOLUTION IMAGES WITH SEMI-SUPERVISED LABEL PROPAGATION. 2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), v. N/A, p. 4-pg., . (16/14760-5, 14/12236-1)
Academic Publications
(References retrieved automatically from State of São Paulo Research Institutions)
MUÑOZ, John Edgar Vargas. Aprendizado de máquina aplicado a dados geográficos abertos. 2019. Doctoral Thesis - Universidade Estadual de Campinas (UNICAMP). Instituto de Computação Campinas, SP.