Extraction of building roof countors through the integration of high-resolution aerial images and LiDAR data, using Markov random field

• Grant number: 12/22332-2
• Support Opportunities: Scholarships in Brazil - Doctorate
• Start date: March 01, 2013
• End date: December 31, 2016
• Field of knowledge: Physical Sciences and Mathematics - Geosciences - Geodesy
• Principal Investigator: Aluir Porfírio Dal Poz
• Grantee: Vanessa Jordão Marcato Fernandes
• Host Institution: Faculdade de Ciências e Tecnologia (FCT). Universidade Estadual Paulista (UNESP). Campus de Presidente Prudente. Presidente Prudente , SP, Brazil

Abstract

This paper proposes a method for the automatic extraction of building roof contours through the combination of LiDAR data and photogrammetric data, and Markov Random Field (MRF). Initially, a normalized digital surface model (nDSM) is generated on the basis of the difference between the digital surface model and the digital terrain model, obtained from the LiDAR point cloud. Then the nDSM is segmented to obtain the polygons representing aboveground objects. These polygons are projected onto image to restrict the search space for image segmentation into regions. This process enables the extraction of polygons in the image representing aboveground objects. To minimize the over-segmentation problem of the image, a Gaussian color invariance model is applied, which aims to eliminate problems of lighting differences within the same object. Building roof contours are identified from among the aboveground objects in the image by optimizing a Markov-random-field-based energy function that embodies roof contour specific properties. Polygons extracted from image and from LiDAR data are used in the MRF model. Therefore, the great challenge of this work is the development of an energy function that responds to configurations of polygons representing, ideally, only building roof contours. The proposed method will be assessed based on real data - high-resolution aerial images and 3D data from LiDAR scanning.

Scientific publications

(6)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

MARCATO FERNANDES, VANESSA JORDAO; DAL POZ, ALUIR PORFIRIO. A Markov-Random-Field Approach for Extracting Straight-Line Segments of Roofs From High-Resolution Aerial Images. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, v. 9, n. 12, 1, SI, p. 5493-5505, DEC 2016. (12/22332-2, 13/13138-0)

MARCATO FERNANDES, VANESSA JORDAO; DAL POZ, ALUIR PORFIRIO. Extraction of building roof contours from the integration of high-resolution aerial imagery and laser data using Markov random fields. INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, v. 9, n. 4, p. 263-286, 2018. (12/22332-2, 13/13138-0)

VANESSA JORDÃO MARCATO FERNANDES; ÉRICO FERNANDO DE OLIVEIRA MARTINS; ALUIR PORFÍRIO DAL POZ; NILTON NOBUHIRO IMAI. FILTRAGEM DE NUVEM LASER PARA GERAÇÃO DE MDT POR KRIGAGEM. Bol. Ciênc. Geod., v. 23, n. 1, p. 196-212, 2017-03-00. (12/22332-2)

DAL POZ, A. P.; FERNANDES, V. J. M.; HEIPKE, C; JACOBSEN, K; STILLA, U; ROTTENSTEINER, F; YILMAZ, A; YINGYANG, M; SKALOUD, J; COLOMINA, I. BUILDING ROOF BOUNDARY EXTRACTION FROM LiDAR AND IMAGE DATA BASED ON MARKOV RANDOM FIELD. XXIII ISPRS CONGRESS, COMMISSION V, v. 42-1, n. W1, p. 6-pg., 2017-01-01. (13/13138-0, 12/22332-2)

DAL POZ, A. P.; FERNANDES, V. J. M.; HALOUNOVA, L; SCHINDLER, K; LIMPOUCH, A; PAJDLA, T; SAFAR, V; MAYER, H; ELBERINK, SO; MALLET, C; et al. EXTRACTION OF ROOF LINES FROM HIGH-RESOLUTION IMAGES BY A GROUPING METHOD. XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, v. 41, n. B3, p. 5-pg., 2016-01-01. (13/13138-0, 12/22332-2)

MARCATO FERNANDES, VANESSA JORDAO; DAL POZ, ALUIR PORFIRIO. A Markov-Random-Field Approach for Extracting Straight-Line Segments of Roofs From High-Resolution Aerial Images. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, v. 9, n. 12, p. 13-pg., 2016-12-01. (13/13138-0, 12/22332-2)

Academic Publications

(References retrieved automatically from State of São Paulo Research Institutions)

FERNANDES, Vanessa Jordão Marcato. Extraction of building roof countors through integration of high-resolution aerial images and LASER data, using Markov random field. 2016. Doctoral Thesis - Universidade Estadual Paulista (Unesp). Faculdade de Ciências e Tecnologia. Presidente Prudente Presidente Prudente.