Architecture and applications for robotics in intelligent environments

• Grant number: 17/01687-0
• Support Opportunities: Regular Research Grants
• Duration: August 01, 2017 - July 31, 2020
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computer Systems
• Principal Investigator: Roseli Aparecida Francelin Romero
• Grantee: Roseli Aparecida Francelin Romero
• Host Institution: Instituto de Ciências Matemáticas e de Computação (ICMC). Universidade de São Paulo (USP). São Carlos , SP, Brazil
• Associated researchers: Artemis Maria Francelin Sanchez Moroni ; Josué Junior Guimarães Ramos
• Associated grant(s): 19/22836-0 - Industry 4.0 system concepts and machine learning for intelligent environment design, AP.R SPRINT

Abstract

Robotic technology is evolving from a situation where robots were completely isolated from people to a situation where robots and humans coexist side by side. The natural evolution of robotic systems is a greater approximation with humans providing physical and social support systems and therefore a comfortable and autonomous life for humans. On the other hand, residential automation projects have been developed for some time, and significant progress can be seen with the so-called smart homes where appliances and electronic devices are connected according to the concept of Internet of Things (IoT). The natural and necessary integration of intelligent houses with robots produces the concept of robotic ecology that offers more robust and modular results than monolithic robots. Robotic ecologies encourage cooperation between robots and intelligent environments as well as providing a more natural communication with humans. The strategy to address this issue involves a number of disciplines, such as: artificial intelligence, machine learning, sensor networks, interface standards, psychology, cognitive science, engineering, among others. This project draws on the knowledge accumulated by the Robot Learning Laboratory of the SCC-ICMC-USP to propose an intelligent home environment that aggregates the following lines of research: robotic ecology, sense ontology, socially acceptable navigation, social robots for entertainment and non-verbal interaction with assistant robot. The expected results include: elaboration of an environment for testing and validation of robotic ecologies, integration of research lines, dissemination of results through publications, theses and dissertations. (AU)

Scientific publications

(14)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

RIBEIRO BELO, JOSE PEDRO; AZEVEDO, HELIO; ROMERO, ROSELI A. F.; DONASCIMENTO, TP; COLOMBINI, EL; DEBRITO, AV; GARCIA, LTD; SA, STD; GONCALVES, LMG. Enhancements in a Social Robotic Simulator for Indoor Environments. 15TH LATIN AMERICAN ROBOTICS SYMPOSIUM 6TH BRAZILIAN ROBOTICS SYMPOSIUM 9TH WORKSHOP ON ROBOTICS IN EDUCATION (LARS/SBR/WRE 2018), v. N/A, p. 7-pg., 2018-01-01. (14/50851-0, 17/01687-0)

RANIERI, CAETANO MAZZONI; MACLEOD, SCOTT; DRAGONE, MAURO; VARGAS, PATRICIA AMANCIO; ROMERO, ROSELI APARECIDA FRANCELIN. Activity Recognition for Ambient Assisted Living with Videos, Inertial Units and Ambient Sensors. SENSORS, v. 21, n. 3, FEB 2021. (17/02377-5, 18/25902-0, 17/01687-0, 13/07375-0)

DE SOUZA NETO, AMADOR MARCELINO; ROMERO, ROSELI A. F.; COLOMBINI, EL; JUNIOR, PLJD; GARCIA, LTD; GONCALVES, LMG; SA, STD; ESTRADA, EDD; BOTELHO, SSD. A decentralized approach to drone formation based on leader-follower technique. 2019 LATIN AMERICAN ROBOTICS SYMPOSIUM, 2019 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR) AND 2019 WORKSHOP ON ROBOTICS IN EDUCATION (LARS-SBR-WRE 2019), v. N/A, p. 5-pg., 2019-01-01. (14/50851-0, 17/01687-0)

AZEVEDO, HELIO; SOUZA, ISAQUE ELCIO; COLOMBINI, EL; JUNIOR, PLJD; GARCIA, LTD; GONCALVES, LMG; SA, STD; ESTRADA, EDD; BOTELHO, SSD. A Simulated Environment for Long-term Interactions. 2019 LATIN AMERICAN ROBOTICS SYMPOSIUM, 2019 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR) AND 2019 WORKSHOP ON ROBOTICS IN EDUCATION (LARS-SBR-WRE 2019), v. N/A, p. 6-pg., 2019-01-01. (14/50851-0, 17/01687-0)

GARCIA, FELIPE APARECIDO; RANIERI, CAETANO MAZZONI; ROMERO, ROSELI A. F.; COLOMBINI, EL; JUNIOR, PLJD; GARCIA, LTD; GONCALVES, LMG; SA, STD; ESTRADA, EDD; BOTELHO, SSD. Temporal Approaches for Human Activity Recognition using Inertial Sensors. 2019 LATIN AMERICAN ROBOTICS SYMPOSIUM, 2019 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR) AND 2019 WORKSHOP ON ROBOTICS IN EDUCATION (LARS-SBR-WRE 2019), v. N/A, p. 5-pg., 2019-01-01. (14/50851-0, 17/01687-0)

RANIERI, CAETANO M.; MOIOLI, RENAN C.; VARGAS, PATRICIA A.; ROMERO, ROSELI A. F.. A neurorobotics approach to behaviour selection based on human activity recognition. OGNITIVE NEURODYNAMIC, v. N/A, p. 20-pg., 2022-09-27. (18/25902-0, 21/10921-2, 13/07375-0, 17/02377-5, 17/01687-0)

BELO, JOSE PEDRO R.; AZEVEDO, HELIO; RAMOS, JOSUE J. G.; ROMERO, ROSELI A. F.. Deep Q-network for social robotics using emotional social signals. FRONTIERS IN ROBOTICS AND AI, v. 9, p. 19-pg., 2022-09-26. (17/01687-0, 18/25782-5)

AZEVEDO, HELIO; RIBEIRO BELO, JOSE PEDRO; ROMERO, ROSELI A. F.; DONASCIMENTO, TP; COLOMBINI, EL; DEBRITO, AV; GARCIA, LTD; SA, STD; GONCALVES, LMG. OntPercept: a Perception Ontology for Robotic Systems. 15TH LATIN AMERICAN ROBOTICS SYMPOSIUM 6TH BRAZILIAN ROBOTICS SYMPOSIUM 9TH WORKSHOP ON ROBOTICS IN EDUCATION (LARS/SBR/WRE 2018), v. N/A, p. 7-pg., 2018-01-01. (14/50851-0, 17/01687-0)

BELO, JOSE PEDRO R.; SANCHES, FELIPE P.; ROMERO, ROSELI A. F.; COLOMBINI, EL; JUNIOR, PLJD; GARCIA, LTD; GONCALVES, LMG; SA, STD; ESTRADA, EDD; BOTELHO, SSD. Facial Recognition Experiments on a Robotic System Using One-Shot Learning. 2019 LATIN AMERICAN ROBOTICS SYMPOSIUM, 2019 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR) AND 2019 WORKSHOP ON ROBOTICS IN EDUCATION (LARS-SBR-WRE 2019), v. N/A, p. 7-pg., 2019-01-01. (14/50851-0, 17/01687-0)

RANIERI, CAETANO M.; NARDARI, GUILHERME; PINTO, ADAM H. M.; TOZADORE, DANIEL C.; ROMERO, ROSELI A. F.; DONASCIMENTO, TP; COLOMBINI, EL; DEBRITO, AV; GARCIA, LTD; SA, STD; et al. LARa: a robotic framework for human-robot interaction on indoor environments. 15TH LATIN AMERICAN ROBOTICS SYMPOSIUM 6TH BRAZILIAN ROBOTICS SYMPOSIUM 9TH WORKSHOP ON ROBOTICS IN EDUCATION (LARS/SBR/WRE 2018), v. N/A, p. 7-pg., 2018-01-01. (14/50851-0, 17/01687-0, 17/02377-5, 17/17444-0)

BELO, JOSE PEDRO R.; ROMERO, ROSELI A. F.; IEEE. A Social Human-Robot Interaction Simulator for Reinforcement Learning Systems. 2021 20TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), v. N/A, p. 6-pg., 2021-01-01. (18/25782-5, 17/01687-0)

TOZADORE, DANIEL C.; PINTO, ADAM H. M.; RANIERI, CAETANO M.; BATISTA, MURILLO R.; ROMERO, ROSELI A. F.; TODT, E; TONIDANDEL, F. Tablets and Humanoid Robots as Engaging Platforms for Teaching Languages. 2017 LATIN AMERICAN ROBOTICS SYMPOSIUM (LARS) AND 2017 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR), v. N/A, p. 6-pg., 2017-01-01. (17/01687-0, 17/02377-5)

RANIERI, CAETANO M.; VARGAS, PATRICIA A.; ROMERO, ROSELI A. F.; IEEE. Uncovering Human Multimodal Activity Recognition with a Deep Learning Approach. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), v. N/A, p. 8-pg., 2020-01-01. (17/02377-5, 13/07375-0, 17/01687-0, 18/25902-0)

SANTOS, IURY B. DE A.; ROMERO, ROSELI A. F.. A Deep Reinforcement Learning Approach with Visual Semantic Navigation with Memory for Mobile Robots in Indoor Home Context. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, v. 104, n. 3, p. 21-pg., 2022-03-01. (17/01687-0)