3D human pose estimation based on monocular RGB images and domain adaptation

• Grant number: 21/02028-6
• Support Opportunities: Scholarships in Brazil - Master
• Effective date (Start): June 01, 2021
• Effective date (End): August 31, 2023
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Aparecido Nilceu Marana
• Grantee: João Renato Ribeiro Manesco
• Host Institution: Faculdade de Ciências (FC). Universidade Estadual Paulista (UNESP). Campus de Bauru. Bauru , SP, Brazil
• Associated scholarship(s): 22/07055-4 - 3D human pose estimation based on monocular RGB images and domain adaptation, BE.EP.MS

Abstract

Human pose estimation in images is an important and challenging problem in Computer Vision. Currently, methods that employ deep learning techniques excel in the task of 2D human pose estimation. 2D poses can be used in a diverse and broad set of applications, of great relevance to society. However, the use of 3D poses can bring even more accurate and robust results. The objective of this research project is to improve the approaches being employed to estimate 3D poses in monocular RGB images. To this end, we intend to use, in the training phase of the methods, datasets of properly labeled, synthetically generated 3D human poses, and to use domain adaptation techniques that allow transferring information from the domain of synthetic images to the domains of images obtained from real environments. To date, no other work has been found in the literature that has investigated the use of deep domain adaptation methods to assist in the estimation of 3D poses in monocular RGB images obtained from real-world scenarios, from 2D poses obtained from synthetic scenarios, using adversarial neural networks. We hope to develop such a method in this work. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

MANESCO, JOAO RENATO RIBEIRO; BERRETTI, STEFANO; MARANA, APARECIDO NILCEU. DUA: A Domain-Unified Approach for Cross-Dataset 3D Human Pose Estimation. SENSORS, v. 23, n. 17, p. 19-pg., 2023-09-01. (22/07055-4, 21/02028-6)

RIBEIRO MANESCO, JOAO RENATO; MARANA, APARECIDO NILCEU; XAVIER-JUNIOR, JC; RIOS, RA. A Survey of Recent Advances on Two-Step 3D Human Pose Estimation. INTELLIGENT SYSTEMS, PT II, v. 13654, p. 16-pg., 2022-01-01. (21/02028-6)