Drone trajectory planning for 3D reconstruction

• Grant number: 20/07892-8
• Support Opportunities: Scholarships in Brazil - Scientific Initiation
• Start date: July 01, 2020
• End date: June 30, 2021
• Field of knowledge: Physical Sciences and Mathematics - Computer Science
• Principal Investigator: Esther Luna Colombini
• Grantee: Tiago Loureiro Chaves
• Host Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
• Company: Universidade de São Paulo (USP). Centro de Inovação da USP (INOVA)
• Associated research grant: 19/07665-4 - Center for Artificial Intelligence, AP.eScience.CPE

Abstract

Accurate 3D reconstructions of objects are essential for several applications, from robotics, computer graphics and virtual reality to medicine, geology, agribusiness and architecture. Unmanned aerial vehicles (UAVs) have been increasingly used to capture aerial images as smaller and more accessible models become available on the market. These images can be used to generate high-quality 3D models of the overflying scene, but the quality of the resulting model depends significantly on the flight plan and the route executed, and still requires experienced pilots for complex environments. Thus, the research related to obtaining images for the reconstruction of large structures has been gaining importance, especially with regard to the perception capacity of these vehicles. In general, due to the lack of accurate (and current) information about the environment, and also for safety reasons, automated solutions with drones resort to flights in regular patterns at a safe air distance. However, the views captured are, in many cases, insufficient for high-quality 3D reconstruction. Thus, the transition from automated systems to autonomous systems is fundamental. In this scenario, this project proposes to explore a way to optimize the flight path in real time, based essentially on the vision acquired through an RGB camera attached to the robot, in order to improve the final reconstruction of the area of interest.