Advanced search
Start date

Autonomous vehicles multi obstacle tracking with sensor fusion.

Grant number: 15/26293-0
Support Opportunities:Scholarships in Brazil - Doctorate
Effective date (Start): July 01, 2016
Effective date (End): July 31, 2019
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computer Systems
Principal Investigator:Denis Fernando Wolf
Grantee:Thomio Watanabe
Host Institution: Instituto de Ciências Matemáticas e de Computação (ICMC). Universidade de São Paulo (USP). São Carlos , SP, Brazil


Autonomous vehicles development are still a challenge. Despite the latest advances in computer vision the provided solutions are not reliable enough to allow the commercial application of the technology. The high amount of elements and events found in road traffic demand the use of robust solutions that are applicable to any situation. While a completely autonomous vehicle is infeasible the automation is being implemented gradually where automobile manufacturers add new functionalities to ease driving and increase security.This PhD proposal will focus on multiple vehicles tracking in urban traffic through video cameras and LIDAR sensor fusion. Tracking may be defined as the object trajectory estimation. The information about obstacles trajectory helps improve autonomous vehicles navigation as it is the base to analyze other vehicles behavior. In turn, objects tracking depends on objects detection. While obstacles detection have reliable solutions, obstacles tracking based in purely computer vision solutions still present major issues. In some proposed solutions besides the high accuracy error, partial occlusion of obstacles prevents he algorithms to work properly. Computer vision tracking solutions have the three main steps: image acquisition, preprocessing and detection, creating a long pipeline where errors propagate in each one of them. The LIDAR sensor provides straight information about the position of the surrounding objects using point clouds. As there is no need to calculate obstacles distance or velocity using images, it is expected to find more reliable results and to reduce the computational cost in tracking obstacles.For obstacles detection is suggested the use of HOG descriptor and SVMs classifiers. The tracking should be based in the Kalman filter and KLD Adaptive Particle Filter Tracker. The main scientific contribution of this work is the image and point cloud fusion to solve problems in multiple obstacles tracking with partial occlusion in real-time applications.

News published in Agência FAPESP Newsletter about the scholarship:
Articles published in other media outlets (0 total):
More itemsLess items

Scientific publications
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
WATANABE, THOMIO; WOLF, DENIS F.. Image classification in frequency domain with 2SReLU: A second harmonics superposition activation function. APPLIED SOFT COMPUTING, v. 112, . (15/26293-0)

Please report errors in scientific publications list by writing to: