Pairwise registration in indoor environments using adaptive combination of 2D and 3D cues

Autor(es)

Perafan Villota, Juan Carlos ^{[1, 2]} ; da Silva, Felipe Leno ^[1] ; Jacomini, Ricardo de Souza ^[1] ; Reali Costa, Anna Helena ^[1]

Afiliação do(s) autor(es)

^[1] Univ Sao Paulo, Dept Engn Comp & Sistemas Digitais, Escola Politecn, Ave Prof Luciano Gualberto, Trav 3, 158, Sao Paulo - Brazil

^[2] Univ Autonoma Occidente, Dept Automat & Elect, Fac Ingn, Cll 25 115-85 Km 2 Via Cali Jamundi, Cali - Colombia

• Tipo de documento: Artigo Científico
• Fonte: Image and Vision Computing; v. 69, p. 113-124, JAN 2018.
• Citações Web of Science: 0

Resumo

Pairwise frame registration of indoor scenes with sparse 2D local features is not particularly robust under varying lighting conditions or low visual texture. In this case, the use of 3D local features can be a solution, as such attributes come from the 3D points themselves and are resistant to visual texture and illumination variations. However, they also hamper the registration task in cases where the scene has little geometric structure. Frameworks that use both types of features have been proposed, but they do not take into account the type of scene to better explore the use of 2D or 3D features. Because varying conditions are inevitable in real indoor scenes, we propose a new framework to improve pairwise registration of consecutive frames using an adaptive combination of sparse 2D and 3D features. In our proposal, the proportion of 2D and 3D features used in the registration is automatically defined according to the levels of geometric structure and visual texture contained in each scene. The effectiveness of our proposed framework is demonstrated by experimental results from challenging scenarios with datasets including unrestricted RGB-D camera motion in indoor environments and natural changes in illumination. (C) 2017 Elsevier B.V. All rights reserved. (AU)

• Processo FAPESP: 16/21047-3 - ALIS: Aprendizado Autônomo em Sistemas Inteligentes
• Beneficiário: Anna Helena Reali Costa
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Processo FAPESP: 15/16310-4 - Transferência de Conhecimento no Aprendizado por Reforço em Sistemas Multiagentes
• Beneficiário: Felipe Leno da Silva
• Modalidade de apoio: Bolsas no Brasil - Doutorado