Advanced search
Start date
Betweenand

Augmented cognition using wearable computing

Grant number: 15/26802-1
Support type:Scholarships in Brazil - Doctorate (Direct)
Effective date (Start): July 01, 2016
Effective date (End): February 28, 2021
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computer Systems
Principal Investigator:Carlos Hitoshi Morimoto
Grantee:Carlos Eduardo Leão Elmadjian
Home Institution: Instituto de Matemática e Estatística (IME). Universidade de São Paulo (USP). São Paulo , SP, Brazil
Associated scholarship(s):17/06933-0 - Augmented cognition through wearable computing, BE.EP.DD

Abstract

In this project we will investigate how to use wearable computers to enhance human cognition capacity, for example, by enhancing perception and improving memory performance. Such augmented cognition applications require information to be presented in a simple and efficient way, at appropriate times, with minimum user intervention. The motivation for this study comes from the current limitation of most wearable computing applications since they do not exploit the potential constancy associated to wearable devices. This property requires wearable applications to be designed for low and divided attention, not to interfere with other user tasks. We will use smart glasses with a Head-Up Display (HUD) for the development of this project. The HUD will show information about the scene or the task being executed by the user. Using a social scenario for example, the scene camera of the smart glasses can be used to detect and recognize faces, and automatically display information about these people on the HUD. Besides the problems of visualization and presentation of the information, we will design and investigate novel interaction methods using other emerging technologies such as eye tracking and RGBD cameras that will allow us to exploit head and gaze gestures to further enrich our wearable applications and the overall user experience. (AU)