A study of image representations from multiple domains using unsupervised and semi-supervised deep learning

• Grant number: 19/02033-0
• Support Opportunities: Scholarships in Brazil - Master
• Effective date (Start): September 01, 2019
• Effective date (End): March 31, 2021
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Moacir Antonelli Ponti
• Grantee: Gabriel Biscaro Cavallari
• Host Institution: Instituto de Ciências Matemáticas e de Computação (ICMC). Universidade de São Paulo (USP). São Carlos , SP, Brazil

Abstract

Deep neural networks for image processing and representation learning are currently applied with great success in tasks for which there is annotation available. Although some architectures are capable of generalizing for different problems, there is a gap in the study of unsupervised representation learning, or also under the context of few shot learning. In this sense, this project proposes the study of combinations of unsupervised and supervised architectures and their loss functions, investigating training strategies to allow finding general representations, not only for the training data domain, but also for alternative domains. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

CAVALLARI, GABRIEL B.; PONTI, MOACIR A.; IEEE COMP SOC. Semi-supervised siamese network using self-supervision under scarce annotation improves class separability and robustness to attack. 2021 34TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2021), v. N/A, p. 8-pg., 2021-01-01. (19/07316-0, 19/02033-0)

PONTI, MOACIR A.; DOS SANTOS, FERNANDO P.; RIBEIRO, LEO S. F.; CAVALLARI, GABRIEL B.; IEEE COMP SOC. Training Deep Networks from Zero to Hero: avoiding pitfalls and going beyond. 2021 34TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2021), v. N/A, p. 8-pg., 2021-01-01. (19/07316-0, 17/22366-8, 19/02033-0)

Academic Publications

(References retrieved automatically from State of São Paulo Research Institutions)

CAVALLARI, Gabriel Biscaro. A study of image representations from multiple domains using unsupervised and semi-supervised deep learning. 2022. Master's Dissertation - Universidade de São Paulo (USP). Instituto de Ciências Matemáticas e de Computação (ICMC/SB) São Carlos.