Assist - telepresence application with augmented reality for remote support

• Grant number: 18/21817-9
• Support Opportunities: Research Grants - Innovative Research in Small Business - PIPE
• Start date: August 01, 2019
• End date: March 31, 2020
• Field of knowledge: Physical Sciences and Mathematics - Computer Science
• Principal Investigator: Marcelo Aparecido Pelegrini
• Grantee: Marcelo Aparecido Pelegrini
• Company: Sense Plus Consultoria e Desenvolvimento Ltda
• CNAE: Desenvolvimento e licenciamento de programas de computador customizáveis ; Desenvolvimento e licenciamento de programas de computador não-customizáveis ; Pesquisa e desenvolvimento experimental em ciências físicas e naturais
• City: São Paulo
• Associated scholarship(s): 19/18011-5 - Developing an experimental telepresence system with augmented reality interactions, BP.TT

Abstract

The main challenge face by field workers is the lack of information and/or experience to develop the activities. In critical moments, an efficient communication with supervisors and specialists is essential. However, the communication is not always effective because the supervisor has difficulty on understanding the situation the field worker is facing. This proposal objective is demonstrating the technological viability of a product that applies Augmented (AR) and real time video calls by adapting de Visual Simultaneous Localization and Mapping (SLAM) technologies to solve the problem. Another project objective is prove that is feasible to deploy the solution in lower costs devices that do not have a depth sensor, replacing hardware capabilities by software functionalities. The proposed methodology comprehend adjusting a Visual SLAM algorithm form a third party software development kit (SDK) to map real environments captured by the camera and transmitted through video calls. We will compare the performance of the mapping with applications in hardware that use depth sensors. The developed prototype must allow movement without losing AR information. As a result, we expect to achieve a prototype with same mapping technologies maturity level as international product, but allowing the use of lower cost Smart Glasses. From functional perspective, we will have a tool that allows video calls with supervisor visualizing the environment seen by the field worker and AR interactions. Our approach finds application in any company that has fieldwork and presents need for communication with remote sites. The application allows flexibility for information access and restrict knowledge. That includes industries such as manufacturing, civil construction, utilities, oil& gas, telecommunications, transportation, and others. Duo to the diversity of applications, it is possible to assume that the market for the product is extremely attractive. Developing this product represents a unique opportunity for Brazilian market to have access to a product with advanced AR capabilities, with Portuguese language and local support. As international companies with similar products did not demonstrate interest in bringing solutions to Brazil in short-term. Brazilian companies have the opportunity to stablish themselves as specialists and suppliers and to achieve a considerable market share for this type of solutions. (AU)