RAFIKI: Retrieval-Based Application for Imaging and Knowledge Investigation

Author(s):Show less -

Nesso-, Marcos R., Jr. ; Cazzolato, Mirela T. ; Scabora, Lucas C. ; Oliveira, Paulo H. ; Spadon, Gabriel ; de Souza, Jessica A. ; Oliveira, Willian D. ; Chino, Daniel Y. T. ; Rodrigues-, Jose F., Jr. ; Traina, Agma J. M. ; Traina-, Caetano, Jr. ; Hollmen, J ; McGregor, C ; Soda, P ; Kane, B

• Document type: Journal article
• Source: 2018 31ST IEEE INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS 2018); v. N/A, p. 6-pg., 2018-01-01.

Abstract

Medical exams, such as CT scans and mammograms, are obtained and stored every day in hospitals all over the world, including images, patient data, and medical reports. It is paramount to have tools and systems to improve computer-aided diagnoses based on such huge volumes of stored information. The Content-Based Image Retrieval (CBIR) is a powerful paradigm to help reaching such a goal, providing physicians with intelligent retrieval tools to present him/her with similar or complementary cases, in which visual characteristics improve textual data. Employing comparative inspection on previous cases, the physician can obtain a more comprehensive understanding of the case he/she is working on. Current hospital systems do not carry native CBIR functionalities yet, relying on add-on subsystems, which often do not adhere to the existing relational database infrastructures. In this work, we propose RAFIKI, a software prototype that extends the Relational Database Management System (RDBMS) PostgreSQL, providing native support for CBIR functionalities, modular extensibility, and seamless integration for data science tools, such as Python and R. We show the applicability of our system by evaluating three clinical scenarios, performing queries over a real-world image dataset of lung exams. Our results spot actual potential in promoting informed decision-making from the physician's perspective. Besides, the system exhibited a higher performance when compared to previous systems found in the literature. Moreover, RAFIKI contributes with a model to establish how to put together CBIR concepts and relational data, providing a powerful design for further development of theoretical and practical concepts and tools. (AU)

• FAPESP's process: 13/21378-1 - Study and Development of Metric Access Methods Using Semantic Data Grouping
• Grantee: Jessica Andressa de Souza
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 17/08376-0 - Analysis and improvement of urban systems using digital maps in the form of complex networks
• Grantee: Gabriel Spadon de Souza
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 16/17330-1 - Storage and Navigation Operations on Graphs in Relational DBMS
• Grantee: Lucas de Carvalho Scabora
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 15/15392-7 - Indexing Attribute Domains in Relational DBMS
• Grantee: Paulo Henrique de Oliveira
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 16/17078-0 - Mining, indexing and visualizing Big Data in clinical decision support systems (MIVisBD)
• Grantee: Agma Juci Machado Traina
• Support Opportunities: Research Projects - Thematic Grants