Terrain Identification for Humanoid Robots Applying Convolutional Neural Networks

Author(s)

Venancio, Murilo Mendonca ^[1] ; Gonalves, Rogerio Sales ^[1] ; da Costa Bianchi, Reinaldo Augusto ^[2]

Affiliation

^[1] Univ Fed Uberlandia, Dept Mech Engn, BR-38400902 Uberlandia, MG - Brazil

^[2] Univ Ctr FEI, Dept Elect Engn, BR-09850901 Sao Bernardo Do Campo - Brazil

• Document type: Journal article
• Source: IEEE-ASME TRANSACTIONS ON MECHATRONICS; v. 26, n. 3, p. 1433-1444, JUN 2021.
• Web of Science Citations: 1

Abstract

Stable and efficient walking strategies for humanoid robots usually relies on assumptions regarding terrain characteristics. If the robot is able to classify the ground type at the footstep moment, it is possible to take preventive actions to avoid falls and to reduce energy consumption. In this article, a new terrain identification method that makes use of a convolutional neural network to classify the terrain type is proposed. The input of this network is a bidimensional matrix-a signature image of the impact-composed of raw data from inertial and torque sensors, sampled after the impact between the foot and ground. Six different terrains types were selected for testing the proposed approach: these terrains were tested both in simulation using the Gazebo 9.0 environment and with one real robot, designed to satisfy the requirements for the RoboCup Humanoid Competition. In both robots the ROS framework was used, and the LIPM was the selected approach for the biped walking pattern generation. Results showed that the proposed method was able to classify the terrain type with an accuracy greater than 98% for both real and virtual situations, surpassing current state-of-the-art terrain classification methods for legged robots. (AU)

• FAPESP's process: 19/07665-4 - Center for Artificial Intelligence
• Grantee: Fabio Gagliardi Cozman
• Support Opportunities: Research Grants - Research Program in eScience and Data Science - Research Centers in Engineering Program