Visual Active Learning guided by Feature Projections

• Grant number: 19/10705-8
• Support Opportunities: Scholarships in Brazil - Doctorate
• Start date: March 01, 2020
• End date: July 14, 2024
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Alexandre Xavier Falcão
• Grantee: Bárbara Caroline Benato
• Host Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
• Associated research grant: 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?, AP.TEM
• Associated scholarship(s): 22/12668-5 - Exploring visual analytics for supporting the user in active learning, BE.EP.DR

Abstract

Machine Learning models can be very effective when the number of labeled training samples is high. In some areas, such as Medicine and Biology, large labeled training sets are very difficult to be obtained, given that the manual annotation of such datasets is time-consuming and requires specialists. In general, data annotation based on the visual inspection (supervision) of each training sample (object) is a laborious process, especially when the number of required samples is large. In order to mitigate user effort in data annotation, many studies have adopted active learning techniques in which an apprentice classifier suggests informative samples for user supervision. It is expected that the classifier, retrained with those additional annotated samples, performs better in a next iteration. However, finding a small and effective set of informative samples for user supervision may be difficult since it also depends on the feature space. As a result, the number of active learning iterations (number of supervised samples) and user involvement can still be high. With similar aim, we have presented interactive data annotation techniques guided by feature projection as part of the Master's thesis of the candidate. In these works, the user can visualize supervised (small set) and unsupervised (large set) training samples on a 2D projection space and propagate labels to the unsupervised ones, with and without assistance of a pattern classifier, but with no further object supervision. In this Doctoral proposal, we intend to extend our previous work by investigating and developing the combination of visual analytics, feature learning, and active learning techniques for the design of more effective image classification systems with minimum user effort in data annotation. The proposal also includes a period abroad at the University of Utrecht under the supervision of Prof. Alexandru Telea --- a recognized expert in Visual Analytics.

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

BENATO, BARBARA C.; TELEA, ALEXANDRA C.; FALCAO, ALEXANDRE X.; IEEE COMP SOC. Iterative Pseudo-Labeling with Deep Feature Annotation and Confidence-Based Sampling. 2021 34TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2021), v. N/A, p. 7-pg., 2021-01-01. (19/10705-8, 14/12236-1)

BENATO, BARBARA C.; FALCAO, ALEXANDRE X.; TELEA, ALEXANDRU C.. Measuring the quality of projections of high-dimensional labeled data. COMPUTERS & GRAPHICS-UK, v. 116, p. 11-pg., 2023-11-01. (22/12668-5, 14/12236-1, 19/10705-8)

DE SOUZA, ITALOS ESTILON; BENATO, BARBARA C.; FALCAO, ALEXANDRE XAVIER; IEEE. Feature Learning from Image Markers for Object Delineation. 2020 33RD SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2020), v. N/A, p. 8-pg., 2020-01-01. (14/12236-1, 19/10705-8)