Everything you wanted to know about Deep Learning for Computer Vision but were afraid to ask

Author(s)

Ponti, Moacir A. ; Ribeiro, Leonardo S. F. ; Nazare, Tiago S. ; Bui, Tu ; Collomosse, John ; IEEE

• Document type: Journal article
• Source: 2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES TUTORIALS (SIBGRAPI-T); v. N/A, p. 25-pg., 2017-01-01.

Abstract

Deep Learning methods are currently the state-of-the-art in many Computer Vision and Image Processing problems, in particular image classification. After years of intensive investigation, a few models matured and became important tools, including Convolutional Neural Networks (CNNs), Siamese and Triplet Networks, Auto-Encoders (AEs) and Generative Adversarial Networks (GANs). The field is fast-paced and there is a lot of terminologies to catch up for those who want to adventure in Deep Learning waters. This paper has the objective to introduce the most fundamental concepts of Deep Learning for Computer Vision in particular CNNs, AEs and GANs, including architectures, inner workings and optimization. We offer an updated description of the theoretical and practical knowledge of working with those models. After that, we describe Siamese and Triplet Networks, not often covered in tutorial papers, as well as review the literature on recent and exciting topics such as visual stylization, pixel-wise prediction and video processing. Finally, we discuss the limitations of Deep Learning for Computer Vision. (AU)

• FAPESP's process: 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry
• Grantee: Francisco Louzada Neto
• Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC
• FAPESP's process: 17/10068-2 - Dimensionality reduction methods for representations generated by triplet convolutional networks
• Grantee: Leo Sampaio Ferraz Ribeiro
• Support Opportunities: Scholarships in Brazil - Scientific Initiation
• FAPESP's process: 15/04883-0 - Unusual event detection in surveillance videos
• Grantee: Tiago Santana de Nazare
• Support Opportunities: Scholarships in Brazil - Doctorate (Direct)