Remote collaboration platatform with access to multiple data sources

• Grant number: 22/13664-3
• Support Opportunities: Research Grants - Innovative Research in Small Business - PIPE
• Start date: May 01, 2023
• End date: May 31, 2024
• Field of knowledge: Physical Sciences and Mathematics - Computer Science
• Agreement: SEBRAE-SP
• Principal Investigator: Diogo Serra Baldissin
• Grantee: Diogo Serra Baldissin
• Company: Sense Plus Consultoria e Desenvolvimento Ltda
• CNAE: Desenvolvimento e licenciamento de programas de computador customizáveis ; Desenvolvimento e licenciamento de programas de computador não-customizáveis ; Pesquisa e desenvolvimento experimental em ciências físicas e naturais
• City: São Paulo
• Associated researchers: Cleyton Alves Bomfim ; Flavio Minoru Maruyama
• Associated scholarship(s): 23/05150-2 - Implementation and Validation of the Remote Collaboration Platform with Access to Multiple Data Sources, BP.TT

Abstract

Validation of a remote collaboration platform with access to multiple data sources in a hydroelectric power plant environment. The solution aims to facilitate access to data from engineering projects in the field and communication between professionals located in the office and at the Hydroelectric Power Plant. With the solution, the local team accesses data from BIM-based projects and visualizes them in the real world by applying Augmented Reality technology and Smart Glasses in order to identify interferences in the civil, electrical and mechanical areas between new projects and existing structures. The solution also allows experts to collaborate via video call and Augmented Reality to solve issues through remote support functionality. This is one of the main challenges facing SPIC Brasil's project area. The partner company has a hydroelectric plant upgrade project carried out until 2030, which includes replacement of electrical panels, protection systems, generation machines and civil structure. Modernization demands changes in the civil, electrical and mechanical areas simultaneously, presenting risks of incompatibility between projects and existing structures. The projection of 3D models in Augmented Reality aims to reduce these risks that can impact the company and society. The need to postpone a structure implementation event by 24 hours can cost the company up to R$ 1 million, due to the additional downtime of the plant. This additional stop may impact the Electric Power System, with the National System Operator as the entity that acts so that contingencies can mitigate the impact of the additional stop. In addition, specialists and project supervisors are often not at the plant, having to support local teams remotely. In this context, the challenge is to improve the form of communication, and the solution integrates Augmented Reality technology and video calls to facilitate this interaction. In addition to impacting productivity, this platform functionality avoids unnecessary displacements, reflecting in cost reduction and mitigates the environmental impact of trips that demand air and land transport, collaborating with the Sustainable Development Goal 9-4-1. The main technology employed by the solution is Augmented Reality based on Visual Simultaneous Localization and Mapping (SLAM) algorithms that seek reference in the world for the projection of objects. The technique used in the project combines Google ARCore SDKs to interpret the real world positioning based on the detection of planes and the recognition of printed images (tags/QR code) for positioning the 3D objects in the correct coordinates. Augmented Reality technology is integrated with other technologies to meet the application's business requirements, such as BIM, Smart Glasses and video calling. The project's objective is to validate the application of the solution at the São Simão Hydroelectric Power Plant by building several scenarios for application in the real world together with the progress of the modernization of the Plant, aiming to meet two objectives: to prove that its application allows the identification of failures in projects, achieving their expected benefits and raising the project's maturity level from TRL 6 to TRL9 by improving its adherence to the market based on validation in the partner company's environment, making usability and applicability adjustments to the work process of the civil construction segment, electrical and mechanical projects. The final result is a commercially validated product, with good customer acceptance, meeting technical and market requirements. The proposed approach finds application in the civil construction, electric energy, oil & gas, telecommunications, transport, industries and public works, among others. (AU)