Research Grants 22/09644-7 - Internet das coisas, Inteligência artificial - BV FAPESP
Advanced search
Start date
Betweenand

Exploring the multimodal approach in flood detection and prediction

Grant number: 22/09644-7
Support Opportunities:Regular Research Grants
Start date: February 01, 2023
End date: January 31, 2025
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computer Systems
Principal Investigator:Jó Ueyama
Grantee:Jó Ueyama
Host Institution: Instituto de Ciências Matemáticas e de Computação (ICMC). Universidade de São Paulo (USP). São Carlos , SP, Brazil
Associated researchers:Caetano Mazzoni Ranieri ; Maria Mercedes Gamboa Medina

Abstract

This project aims to explore the multimodal approach for detecting and predicting floods. By multimodal, we mean that different sensing approaches will be explored to monitor urban rivers. The first sensor to be considered is an infrared sensor to measure the water level of the water stream. The second sensor are video cameras that capture images of the river in real-time, which are analyzed later. The third sensor is a barcode, which is being studied. The fourth consists of the use of artificial intelligence in monitoring urban rivers. The multimodal approach is usually explored for everyday tasks. For example, if a person wants to recognize the emotional state of another, he or she analyzes various modalities such as speech, face and body language. Studies have shown that the multimodal approach increases the success rate in recognizing emotions. This proposal aims to explore this approach in flood detection/prediction. (AU)

Articles published in Agência FAPESP Newsletter about the research grant:
More itemsLess items
Articles published in other media outlets ( ):
More itemsLess items
VEICULO: TITULO (DATA)
VEICULO: TITULO (DATA)

Scientific publications
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
RANIERI, CAETANO M.; FOLETTO, ANGELO V. K.; GARCIA, RODRIGO D.; MATOS, SAULO N.; MEDINA, MARIA M. G.; MARCOLINO, LEANDRO S.; UEYAMA, JO. Water level identification with laser sensors, inertial units, and machine learning. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, v. 127, p. 17-pg., . (22/09644-7, 21/10921-2, 13/07375-0)
RANIERI, CAETANO MAZZONI; SOUZA, THAIS LUIZA DONEGA E; NISHIJIMA, MARISLEI; KRISHNAMACHARI, BHASKAR; UEYAMA, JO. A deep learning workflow enhanced with optical flow fields for flood risk estimation. APPLIED INTELLIGENCE, v. 54, n. 7, p. 22-pg., . (22/09644-7, 21/10921-2, 13/07375-0)