Advanced search
Start date
Betweenand


Test-Time Selection for Robust Skin Lesion Analysis

Full text
Author(s):
Bissoto, Alceu ; Barata, Catarina ; Valle, Eduardo ; Avila, Sandra
Total Authors: 4
Document type: Journal article
Source: MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023 WORKSHOPS; v. 14393, p. 10-pg., 2023-01-01.
Abstract

Skin lesion analysis models are biased by artifacts placed during image acquisition, which influence model predictions despite carrying no clinical information. Solutions that address this problem by regularizing models to prevent learning those spurious features achieve only partial success, and existing test-time debiasing techniques are inappropriate for skin lesion analysis due to either making unrealistic assumptions on the distribution of test data or requiring laborious annotation from medical practitioners. We propose TTS (Test-Time Selection), a human-in-the-loop method that leverages positive (e.g., lesion area) and negative (e.g., artifacts) keypoints in test samples. TTS effectively steers models away from exploiting spurious artifact-related correlations without retraining, and with less annotation requirements. Our solution is robust to a varying availability of annotations, and different levels of bias. We showcase on the ISIC2019 dataset (for which we release a subset of annotated images) how our model could be deployed in the real-world for mitigating bias. (AU)

FAPESP's process: 13/08293-7 - CCES - Center for Computational Engineering and Sciences
Grantee:Munir Salomao Skaf
Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC
FAPESP's process: 19/19619-7 - Generating unlimited skin lesion images with generative adversarial networks
Grantee:Alceu Emanuel Bissoto
Support Opportunities: Scholarships in Brazil - Doctorate
FAPESP's process: 22/09606-8 - Understanding the role of shortcuts and distribution shifts in deep learning generalization
Grantee:Alceu Emanuel Bissoto
Support Opportunities: Scholarships abroad - Research Internship - Doctorate
FAPESP's process: 20/09838-0 - BI0S - Brazilian Institute of Data Science
Grantee:João Marcos Travassos Romano
Support Opportunities: Research Grants - Research Centers in Engineering Program