Gaze-Based Interaction in Wearable Computing: an interface for the Internet of Things

• Grant number: 16/10148-3
• Support type: Regular Research Grants
• Duration: February 01, 2017 - March 31, 2019
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computer Systems
• Principal researcher: Carlos Hitoshi Morimoto
• Grantee: Carlos Hitoshi Morimoto
• Home Institution: Instituto de Matemática e Estatística (IME). Universidade de São Paulo (USP). São Paulo , SP, Brazil
• Associated grant(s): 17/50121-0 - AREThA: gaze interaction for the internet of things through augmented reality, AP.R SPRINT
• Associated scholarship(s): 18/12247-4 - Gaze interaction in wearable computing: an interface for the Internet of Things, BP.TT

Abstract

The Internet of Things (IoT) will put at our disposal an endless number of devices that can provide information and communicate with us, with applications in areas as diverse as education, smart cities, and industrial production. A major challenge of this emerging technology is how to create an effective, secure, and robust way to interact with these devices. In this project we propose to investigate the use of wearable computing platformsenhanced with eye trackers, for interaction with IoT devices.Despite recent advancements in wearable computing (WC), this technology has not yet achieved large commercial success, in part due to interaction problems and limited functionality of their apps. Gaze-based interaction also has restricted applications, despite being successfully used in interfaces for people with disabilities. One possible contribution of this project will be the development of a new interaction mode in wearable computing. In particular, for quick and simple interactions with IoT devices, gaze can provide the wearable platform important context information to be used by the wearable applications.One first objective of this project, is to create a wearable computing platform consisting basically of a notebook, a head-up display, and an eye-tracker. Two kinds of displays will be investigated, a monocular and a binocular. After we build this platform, we will investigate how gaze can be used for wearable interaction, by developing new augmented reality interfaces to IoT devices. The project will be developed with the participation of several graduate and undergraduate students from USP. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

BORSATO, FRANK H.; DIAZ-TULA, ANTONIO; MORIMOTO, CARLOS H.. xSDL: stroboscopic differential lighting eye tracker with extended temporal support. MACHINE VISION AND APPLICATIONS, v. 30, n. 4, p. 689-703, JUN 2019. (12/04426-0, 16/10148-3)