Pairwise registration in indoor environments using adaptive combination of 2D and 3D cues

Author(s)

Perafan Villota, Juan Carlos ^{[1, 2]} ; da Silva, Felipe Leno ^[1] ; Jacomini, Ricardo de Souza ^[1] ; Reali Costa, Anna Helena ^[1]

Affiliation

^[1] Univ Sao Paulo, Dept Engn Comp & Sistemas Digitais, Escola Politecn, Ave Prof Luciano Gualberto, Trav 3, 158, Sao Paulo - Brazil

^[2] Univ Autonoma Occidente, Dept Automat & Elect, Fac Ingn, Cll 25 115-85 Km 2 Via Cali Jamundi, Cali - Colombia

• Document type: Journal article
• Source: Image and Vision Computing; v. 69, p. 113-124, JAN 2018.
• Web of Science Citations: 0

Abstract

Pairwise frame registration of indoor scenes with sparse 2D local features is not particularly robust under varying lighting conditions or low visual texture. In this case, the use of 3D local features can be a solution, as such attributes come from the 3D points themselves and are resistant to visual texture and illumination variations. However, they also hamper the registration task in cases where the scene has little geometric structure. Frameworks that use both types of features have been proposed, but they do not take into account the type of scene to better explore the use of 2D or 3D features. Because varying conditions are inevitable in real indoor scenes, we propose a new framework to improve pairwise registration of consecutive frames using an adaptive combination of sparse 2D and 3D features. In our proposal, the proportion of 2D and 3D features used in the registration is automatically defined according to the levels of geometric structure and visual texture contained in each scene. The effectiveness of our proposed framework is demonstrated by experimental results from challenging scenarios with datasets including unrestricted RGB-D camera motion in indoor environments and natural changes in illumination. (C) 2017 Elsevier B.V. All rights reserved. (AU)

• FAPESP's process: 16/21047-3 - ALIS: Autonomous Learning in Intelligent System
• Grantee: Anna Helena Reali Costa
• Support Opportunities: Regular Research Grants
• FAPESP's process: 15/16310-4 - Transfer Learning in Reinforcement Learning Multi-Agent Systems
• Grantee: Felipe Leno da Silva
• Support Opportunities: Scholarships in Brazil - Doctorate