| Full text | |
| Author(s): |
Perin, Gabriel J.
;
Hirata, Nina S. T.
Total Authors: 2
|
| Document type: | Journal article |
| Source: | 2024 37TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES, SIBGRAPI 2024; v. N/A, p. 6-pg., 2024-01-01. |
| Abstract | |
Motivated by the inherent data scarcity in the medical domain, this work studies few-shot retinal disease classification, using the Brazilian Multilabel Ophtalmological Dataset. We compare different network architectures and non-trivial data augmentations under the application of the Reptile Algorithm, conducting quantitative and qualitative analysis. Regarding the architectures, we observe that Swin outperforms ViT and ResNet. We also observe that clever data augmentations not only improve performance, but can also generate prediction confidence distributions that are more interpretable and trustworthy. Furthermore, pre-training the models with domain-specific data leads to superior ability of the models to detect the relevant patterns in the images. Code is available at github.com/gabjp/few-shot-BRSET. (AU) | |
| FAPESP's process: | 23/15047-4 - Model Merging for Large Language Model |
| Grantee: | Gabriel Jacob Perin |
| Support Opportunities: | Scholarships abroad - Research Internship - Scientific Initiation |
| FAPESP's process: | 22/11645-1 - Classification of stars, galaxies, and quasars based on photometric multiband images |
| Grantee: | Gabriel Jacob Perin |
| Support Opportunities: | Scholarships in Brazil - Scientific Initiation |
| FAPESP's process: | 22/15304-4 - Learning context rich representations for computer vision |
| Grantee: | Nina Sumiko Tomita Hirata |
| Support Opportunities: | Research Projects - Thematic Grants |