Exploiting the Internet of Things with Artificial Intelligence in the context of Health Smart Homes: a physical and emotional approach

• Grant number: 16/14267-7
• Support Opportunities: Scholarships in Brazil - Doctorate
• Start date: January 01, 2017
• End date: September 30, 2019
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Jó Ueyama
• Grantee: Leandro Yukio Mano Alves
• Host Institution: Instituto de Ciências Matemáticas e de Computação (ICMC). Universidade de São Paulo (USP). São Carlos , SP, Brazil
• Associated research grant: 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry, AP.CEPID
• Associated scholarship(s): 17/21054-2 - Combining Intelligence Artificial and Multimodal for Emotion Classification, BE.EP.DR

Abstract

Owing to a growth in the number of elderly people and those with physical/mental impairments, there has been a comparable increase of studies in the area of Internet of Things (IoT) that seek to monitor health, give assistance to management and enhance the quality of life for this sector of society. For this reason, the aim of an IoT-based approach when adopted in medical environments and smart homes is to provide connectivity between the patients and their surroundings by offering mechanisms to assist in the investigation and prevention of accidents and/or diseases. This gives rise to an opportunity to exploit computational systems to determine the physical and emotional state in real time, of people with some kind of handicap so as to monitor their health. This might involve discovering the behavioral pattern of the users' routine and issuing alerts to the families and/or medical teams with regard to some abnormal event or noting the first signs of the onset of a depression. On the basis of artificial intelligence, it is also possible to enable computing systems to "learn" and be adapted to the situation they are in, for example by learning and adapting themselves to the number of exercises and/or emotional states of the users, in particular circumstances that combine concepts of both IoT and Artificial Intelligence. Thus the purpose of this project is to devise and evaluate a model that can: i.) find out the emotional and physical state of the users; ii.) provide a mechanism that can monitor the everyday activities of the users in an intelligent manner; iii.) take advantage of a flexible approach through the use of IoT sensors; and iv.) provide particular and detailed information about the users through a wide range of solutions where their behavioral patterns are analyzed in a distinct and uniform manner , by allowing a better kind of interaction between the computing devices in the Health Smart Homes (HSH) environment.

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

MANO, LEANDRO Y.; MAZZO, ALESSANDRA; NETO, JOSE R. T.; MESKA, MATEUS H. G.; GIANCRISTOFARO, GABRIEL T.; UEYAMA, JO; JUNIOR, GERSON A. P.. Using emotion recognition to assess simulation-based learning. NURSE EDUCATION IN PRACTICE, v. 36, p. 13-19, MAR 2019. (16/14267-7, 16/04261-1, 15/21642-6)

MANO, LEANDRO Y.; BARROS, VINICIUS A.; NUNES, LUIZ H.; SAWADA, LUANA O.; ESTRELLA, JULIO C.; UEYAMA, JO. ENLACE: A Combination of Layer-Based Architecture and Wireless Communication for Emotion Monitoring in Healthcare. MOBILE INFORMATION SYSTEMS, v. 2019, JUL 10 2019. (17/21054-2, 16/14267-7)

MANO, LEANDRO Y.; YILDIRIM, T; MANOLOPOULOS, Y; ANGELOV, P; ILIADIS, L. Emotional condition in the Health Smart Homes environment: emotion recognition using ensemble of classifiers. 2018 INNOVATIONS IN INTELLIGENT SYSTEMS AND APPLICATIONS (INISTA), v. N/A, p. 8-pg., 2018-01-01. (17/21054-2, 16/14267-7)

Academic Publications

(References retrieved automatically from State of São Paulo Research Institutions)

ALVES, Leandro Yukio Mano. Exploiting the Internet of Things with Artificial Intelligence in the context of Health Smart Homes: a physical and emotional approach. 2019. Doctoral Thesis - Universidade de São Paulo (USP). Instituto de Ciências Matemáticas e de Computação (ICMC/SB) São Carlos.