Monitoring of context aware physical environments through the integration of virtual reality, wireless sensor networks and context aware computing areas

• Grant number: 06/00741-7
• Support Opportunities: Regular Research Grants
• Start date: October 01, 2006
• End date: September 30, 2008
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computer Systems
• Principal Investigator: Regina Borges de Araujo
• Grantee: Regina Borges de Araujo
• Host Institution: Centro de Ciências Exatas e de Tecnologia (CCET). Universidade Federal de São Carlos (UFSCAR). São Carlos , SP, Brazil
• City of the host institution: São Carlos

Abstract

The areas of virtual reality, wireless sensor networks and context aware computing can be integrated for the purpose of accurate monitoring of physical environments. This integration aims to overcome the limitations of current interfaces, such as hypermedia or video, when the experiences that occur in the physical environment are very complex and/or change too rapidly. Existing physical environment monitoring systems are typically very specific and, therefore, difficult to be adapted to other application scenarios. These systems exhibit a textual or bidimensional interface what limits the accurate visualization of the events that are ocurring in the physical environment being monitored. The objective of this work is to develop an integrated solution that overcomes the limitation of existing monitoring systems by using Collaborative Virtual Environments - CVEs along with wireless sensor networks that are deployed on the physical environments. The integration of these technologies can provide a natural interface that helps users to understand, with more accuracy, what is happening in the physical environment being monitored. A temperature alteration, for instance, can be imperceptible when the monitoring is made through video. However, it can be easily represented in a 3D environment through colors for instance (like red for high temperatures and blue for low temperatures). In the system to be developed, information is captured from the real world through rehearsals or events collected from a wireless sensor network deployed on a physical environment. This information is interpreted, recorded, mapped into a visual language and reflected on a 3D environment that imitates the physical environment. The 3D CVE visualization can be done in both real time and at posteriori. Five sub-projects will be developed in a partnership with Embraer (Brazilian Aeronautic Company): 1) Project and evaluation of protocols that meet ground rehearsals requirements;2) Interpretation, recording and visual mapping of abnormal situations obtained from flight rehearsals for the aerodynamics pressure distribution over supporting surfaces;3) Interpretation, recording and visual mapping of abnormal situations obtained from flight rehearsals for the pressure and temperature distribution inside a jet-motor;4) Interpretation, recording and visual mapping of abnormal situations obtained from flutter rehearsals;5) Creation of simulations that reflect the cockpit of an aircraft, through the concept of non-linear stories.Additional voice processing interface will be implemented in the 3D CVEs generated. (AU)

Scientific publications

(7)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

BOUKERCHE‚ A.; ARAUJO‚ RB; SILVA‚ FHS; VILLAS‚ L.. Wireless sensor and actor networks context interpretation for the emergency preparedness class of applications. COMPUTER COMMUNICATIONS, v. 30, n. 13, p. 2593-2602, 2007. (06/00741-7)

BOUKERCHE, AZZEDINE; ARAUJ, REGINA B.; IWASAKI, FABIO M.; PIZZOLATO, EDNALDO; IEEE. Real-Time Monitoring Visualization Through On-Line Simulation. 2008 IEEE INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, VOLS 1-5, v. N/A, p. 2-pg., 2008-01-01. (06/00741-7)

BOUKERCHE, AZZEDINE; ZARRAD, ANIS; ARAUJO, REGINA BORGES; IEEE. Optimized PONG caching technique for mobile Gnutella network to support large-scale collaborative virtual environment. GLOBECOM 2007: 2007 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-11, v. N/A, p. 2-pg., 2007-01-01. (06/00741-7)

BOUKERCHE, A.; IWASAKI, F. M.; ARAUJO, R. B.; PIZZOLATO, E. B.; ROBERTS, D; ELSADDIK, A; FERSCHA, A. Web-Based Distributed Simulations Visualization and Control with HLA and Web Services. DS-RT 2008: 12TH 2008 IEEE/ACM INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL TIME APPLICATIONS, PROCEEDINGS, v. N/A, p. 2-pg., 2008-01-01. (06/00741-7)

BOUKERCHE, AZZEDINE; ARAUJO, REGINA B.; VILLAS, LEANDRO; IEEE. A novel QoS based routing protocol for Wireless Actor and Sensor Networks. GLOBECOM 2007: 2007 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-11, v. N/A, p. 2-pg., 2007-01-01. (06/00741-7)

BOUKERCHE, AZZEDINE; ZARRAD, ANIS; ARAUJO, REGINA BORGES; IEEE. A novel optimized caching technique for mobile Gnutella based network to support large-scale collaborative virtual environment. 40TH ANNUAL SIMULATION SYMPOSIUM, PROCEEDINGS, v. N/A, p. 2-pg., 2008-01-01. (06/00741-7)

ROCHA, RAFAELA V.; ARAUJO, REGINA B.; CAMPOS, MARCIO R.; BOUKERCHE, AZZEDINE; TURNER, SJ; ROBERTS, D; CAI, W; ELSADDIK, A. HLA Compliant Training Simulations Creation Tool. DS-RT 2008: 12TH 2008 IEEE/ACM INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL TIME APPLICATIONS, PROCEEDINGS, v. N/A, p. 2-pg., 2009-01-01. (06/00741-7)