FairMI: machine learning fairness with application to medical images

• Grant number: 21/14725-3
• Support Opportunities: Regular Research Grants
• Start date: July 01, 2023
• End date: June 30, 2027
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computer Systems
• Agreement: Swiss National Science Foundation (SNSF)
• Principal Investigator: Lilian Berton
• Grantee: Lilian Berton
• Principal researcher abroad: André Rabello dos Anjos
• Institution abroad: Idiap Research Institute, Switzerland
• Host Institution: Instituto de Ciência e Tecnologia (ICT). Universidade Federal de São Paulo (UNIFESP). Campus São José dos Campos. São José dos Campos , SP, Brazil
• Associated researchers: Anete Trajman ; Carlos Alberto Buchpiguel ; Marcelo Tatit Sapienza
• Associated scholarship(s): 23/12493-3 - Towards fairness in medical images by semi-supervised learning approaches, BP.TT; 23/12468-9 - Framework for fairness mitigation in medical images, BP.PD; 23/10701-8 - Evaluation of fairness machine learning based Computer Aided Design (CAD), BP.TT

Abstract

The algorithmic bias remains one of the key challenges for the wider applicability of Machine Learning (ML) in healthcare. Statistical modeling of natural phenomena has gained traction due to increased representation capacity and data availability. In medicine, particularly, the use of ML models has increased significantly in recent years, especially to support large-scale screening and diagnosis. However impactful, the study of demographic bias of newly developed or already deployed ML solutions in this domain remains largely unaddressed. This is particularly true in the medical imaging domain, where it remains challenging to associate demographic attributes with features. Out of the most recent results, the "impossibility of fairness" establishes some criteria for demographic impartiality that cannot be reached simultaneously. Among other factors, the lack of raw data, in particular for intersections of minorities, is one of the greatest issues that remain unaddressed due to their challenging nature. This proposal addresses three important challenges in the domain of ML fairness for medical imaging: (i) Create novel ways to train ML models for medical imaging tasks, that can be automatically adjusted to become more useful (maximize performance), group or individually fair, (ii) Quantify fairness boundaries of ML models and associated development data, and finally, (iii) Build systems whose joint performance with humans in the decision loop is fair towards various individuals and demographic groups. To achieve these goals, we will develop a novel evaluation framework and loss functions that take into account model utility together with all aspects of demographic fairness one may wish to address. A generative framework, trained to isolate tunable demographic features, will provide large-scale data simulation covering minorities and intersections. We will then study fairness (safety) boundaries through a modified learning curve setup, analyzing and quantifying limits in both ML models and training data. Finally, we will study how humans-in-the-decision-loop affect the fairness of hybrid human-AI systems, and address post-deployment utility/fairness tuning by embedding weight coefficients directly into the trained model. The development of methods and tools to detect, mitigate, or remove bias will improve the safety of ML models deployed in healthcare. We expect our work will help define new operational boundaries for the responsible deployment of artificial intelligence tools. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

SANTOS, MATHEUS A. DE CASTRO; BERTON, LILIAN. An Enhanced Framework for Overcoming Pitfalls and Enabling Model Interpretation in Pneumonia and Covid-19 Classification. IEEE ACCESS, v. 11, p. 18-pg., 2023-01-01. (21/14725-3, 21/11905-0)