| Full text | |
| Author(s): |
Cerqueira, Matheus A.
;
Sprenger, Flavia
;
Teixeira, Bernardo C. A.
;
Guimaraes, Silvio Jamil E.
;
Falcao, Alexandre X.
Total Authors: 5
|
| Document type: | Journal article |
| Source: | 2024 37TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES, SIBGRAPI 2024; v. N/A, p. 6-pg., 2024-01-01. |
| Abstract | |
Deep Learning has shown impressive results in computer vision tasks at the cost of becoming increasingly extensive and requiring a voluminous amount of labeled images. Feature Learning from Image Markers (FLIM) is a method to build convolutional encoders with minimal user effort in image annotation. FLIM estimates the encoder's filters directly from markers drawn by the user (scribbles, clicks) in significant regions of a few representative images (e.g., 9). However, the selection of those few images significantly impacts the model's performance, and image selection is mainly addressed by either the user inspecting all images and subjectively selecting the most relevant ones or by using a method that requires pixel-wise annotation (ground-truth) for recommending images. The main goal of our work is to make this task less subjective by presenting a ground-truth-free method for recommending representative images to train FLIM encoders while guiding the user's choice with a visual explanation. Our method suggests new images based on the distance to the previously selected images, using a proposed descriptor that generates different patterns according to filter attention. The user selects the next image among the suggested ones, which repeats until the user's satisfaction. According to our experiments, the proposed method can outperform expert manual selection and an interactive method based on pixel-wise annotation. These results are demonstrated for brain tumor and gastrointestinal parasite segmentation. (AU) | |
| FAPESP's process: | 23/09210-0 - A Human-in-the-loop Approach to Build Convolutional Neural Networks |
| Grantee: | Matheus Abrantes Cerqueira |
| Support Opportunities: | Scholarships in Brazil - Doctorate |
| FAPESP's process: | 23/14427-8 - Data Science for Smart Industry (CDII) |
| Grantee: | José Alberto Cuminato |
| Support Opportunities: | Research Grants - Research Centers in Engineering Program |
| FAPESP's process: | 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry |
| Grantee: | Francisco Louzada Neto |
| Support Opportunities: | Research Grants - Research, Innovation and Dissemination Centers - RIDC |