ETL Process for SIHSUS Data in a DataLake House

• Grant number: 24/06693-2
• Support Opportunities: Scholarships in Brazil - Scientific Initiation
• Start date: June 01, 2024
• End date: May 31, 2025
• Field of knowledge: Engineering - Electrical Engineering - Industrial Electronics, Electronic Systems and Controls
• Principal Investigator: Elbert Einstein Nehrer Macau
• Grantee: Fernando Daniel Marcelino
• Host Institution: Instituto de Ciência e Tecnologia (ICT). Universidade Federal de São Paulo (UNIFESP). Campus São José dos Campos. São José dos Campos , SP, Brazil
• Associated research grant: 21/10599-3 - The Antimicrobial Resistance Institute of São Paulo (The Aries Project), AP.CEPID

Abstract

Microbial resistance has become a major challenge in healthcare. The increasing number of resistant bacteria, especially in hospitals, is critical. It is essential to acquire knowledge about the incidence of microbial resistance, particularly in public hospitals. Data from public databases, such as DataSus (DATASUS - Sistema Único de Saúde), can be a valuable resource for understanding antimicrobial resistance (AMR) in public hospitals.This project focuses on implementing an ETL (Extract, Transform, Load) process to integrate data from SIHSUS (Hospital Information System) into a Data Lake. A Data Lake is a centralized repository that can store various data types for diverse purposes, including data analysis, research, and development.The scholarship will be responsible for integrating SIHSUS data into the Data Lake. This involves extracting relevant data from SIHSUS, transforming the data into a compatible format, and loading it into the Data Lake.