Development of prototype for inspection of large parts using RGB-D cameras and 3D reconstruction

• Grant number: 19/00940-0
• Support Opportunities: Research Grants - Innovative Research in Small Business - PIPE
• Start date: February 01, 2021
• End date: October 31, 2021
• Field of knowledge: Physical Sciences and Mathematics - Computer Science
• Principal Investigator: Vinicius Benites Bastos
• Grantee: Vinicius Benites Bastos
• Company: Acta Visio Desenvolvimento em Visão Computacional Ltda
• CNAE: Desenvolvimento e licenciamento de programas de computador customizáveis ; Suporte técnico, manutenção e outros serviços em tecnologia da informação
• City: Campinas
• Associated researchers: Alan Ferreira Pinheiro Tavares ; Hélio Pedrini
• Associated scholarship(s): 21/03558-9 - TT4 Grant (Data Processing) - Development of Prototype for Inspection of Large Parts Using RGB-D Cameras and 3D Reconstruction., BP.TT; 21/01414-0 - TT4 grant: development of prototype for inspection of large parts using RGB-D cameras and 3D reconstruction, BP.TT; 21/00249-5 - PE2 Grant: Development of prototype for inspection of large parts using RGB-D cameras and 3D reconstruction, BP.PIPE

Abstract

3D reconstruction is the creation of three-dimensional models from a set of images, capturing the shape and appearance of the real object. There are several applications such as games, movies, biomedical engineering, industry 4.0, and others. Its use in the industry can solve several problems, such as inspection for large parts with varied size, that we found when visiting large companies, inside and outside the state of São Paulo. These companies now use precarious methods for inspection, which can take days to complete only one part. Existing solutions can use LIDAR (Light Detection and Ranging), or even other more expensive sensors, which are accurate but costly. Thus, in order to solve this problem, reducing the costs of these companies and increasing their production volume, this work proposes the creation of 3D reconstruction models for large forged parts (70m3 + / 1000kg +), in order to enable the measurement off -line and quick component inspection. The project will be carried out in partnership with the company Prensas Shuler S.A., which is one of the manufacturers of parts with these characteristics, thus enabling us to test the prototype in a real factory situation. Therefore, in order to develop a product that is flexible with the size of parts, and easy to transport, this proposal evaluates to produce a static scene reconstruction of these parts using a Drone to cover all surfaces, and generate a reliable 3D model to be compared with the CAD file the object. This information will be used to show missing parts and divergent measures for the operator. (AU)