APEHR: Automated Prognosis in Electronic Health Records using multi-head self-attention

Author(s):Show less -

Florez, Alexander Y. C. ; Scabora, Lucas ; Eler, Danilo M. ; Rodrigues-Jr, Jose F. ; Almeida, JR ; Gonzalez, AR ; Shen, L ; Kane, B ; Traina, A ; Soda, P ; Oliveira, JL

• Document type: Journal article
• Source: 2021 IEEE 34TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS); v. N/A, p. 6-pg., 2021-01-01.

Abstract

Automated prognosis has been a topic of intense research. Many works have sought to learn from Electronic Health Records using Recurrent Neural Networks that, despite promising results, have been overcome by novel techniques. We introduce APEHR, a Transformer approach that leverages medical prognosis using the latest technology Neural Network Transformer, which has demonstrated superior results in problems whose data is organized in sequential fashion. We contribute with an innovative problem modeling along with a detailed discussion of how Transformers can be used in the medical domain. Our results demonstrate a prognostic performance that surpasses previous works by at least 6% for metric Recall@k in the public dataset MIMIC-III. (AU)

• FAPESP's process: 16/17330-1 - Storage and Navigation Operations on Graphs in Relational DBMS
• Grantee: Lucas de Carvalho Scabora
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 18/17620-5 - Preventive medicine by means of deep learning techniques applied in healthcare prognosis
• Grantee: José Fernando Rodrigues Júnior
• Support Opportunities: Scholarships abroad - Research
• FAPESP's process: 16/17078-0 - Mining, indexing and visualizing Big Data in clinical decision support systems (MIVisBD)
• Grantee: Agma Juci Machado Traina
• Support Opportunities: Research Projects - Thematic Grants