Advanced search
Start date
Betweenand


CONDITIONAL RECONSTRUCTION FOR OPEN-SET SEMANTIC SEGMENTATION

Full text
Author(s):
Nunes, Ian ; Pereira, Matheus B. ; Oliveira, Hugo ; dos Santos, Jefersson A. ; Poggi, Marcus ; IEEE
Total Authors: 6
Document type: Journal article
Source: 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP; v. N/A, p. 5-pg., 2022-01-01.
Abstract

Open set segmentation is a relatively new and unexplored task, with just a handful of methods proposed to model such tasks. We propose a novel method called CoReSeg that tackles the issue using class conditioned reconstruction of the input images according to their pixelwise mask. Our method conditions each input pixel to all known classes, expecting higher errors for pixels of unknown classes. It was observed that the proposed method produces better semantic consistency in its predictions than the baselines, resulting in cleaner segmentation maps that better fit object boundaries. CoReSeg outperforms state-of-the-art methods on the Vaihingen and Potsdam ISPRS datasets, while also being competitive on the Houston 2018 IEEE GRSS Data Fusion dataset. Our official implementation for CoReSeg is available at: https://github.com/iannunes/CoReSeg. (AU)

FAPESP's process: 20/06744-5 - Deep learning and intermediate representations for pediatric image analysis
Grantee:Hugo Neves de Oliveira
Support Opportunities: Scholarships in Brazil - Post-Doctoral
FAPESP's process: 15/22308-2 - Intermediate representations in Computational Science for knowledge discovery
Grantee:Roberto Marcondes Cesar Junior
Support Opportunities: Research Projects - Thematic Grants