Mining multimodal records: explainable patterns and anomalies discovery

• Grant number: 21/11403-5
• Support type: Scholarships abroad - Research Internship - Post-doctor
• Effective date (Start): February 01, 2022
• Effective date (End): January 31, 2023
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal researcher: Marco Antonio Gutierrez
• Grantee: Mirela Teixeira Cazzolato
• Supervisor abroad: Christos Faloutsos
• Home Institution: Instituto do Coração Professor Euryclides de Jesus Zerbini (INCOR). Hospital das Clínicas da Faculdade de Medicina da USP (HCFMUSP). Secretaria da Saúde (São Paulo - Estado). São Paulo , SP, Brazil
• Research place: Carnegie Mellon University (CMU), United States
• Associated to the scholarship: 20/11258-2 - Interoperability and similarity queries on medical databases, BP.PD

Abstract

The discovery of anomalies and patterns is essential to many applications and areas, such as COVID-19 detection in chest X-Rays and vertebral fracture detection in MRI for health applications, as well as credit analysis in finance, and bot detection in social networks. The mining approach is application-dependent, and the discovered patterns should be shown to specialists using appropriate tools for boosting explainability and understanding, usually by taking advantage of visualization metaphors. In this internship proposal, we aim at exploring multimodal data from multiple application scenarios and types (e.g., images, graphs, electronic health records, and financial transactions) by proposing modular, scalable, and explainable methods. The internship will be carried out at Carnegie Mellon University (CMU), USA. The objectives meet the interests of both the FAPESP thematic project "Mining, Indexing and Visualizing Big Data in Clinical Decision Support Systems - (MIVisBD)" and the current research carried out at CMU by the supervisor and co-supervisor.