Advanced search
Start date
Betweenand

Visual Active Learning guided by Feature Projections

Grant number: 19/10705-8
Support Opportunities:Scholarships in Brazil - Doctorate
Start date: March 01, 2020
End date: July 14, 2024
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
Principal Investigator:Alexandre Xavier Falcão
Grantee:Bárbara Caroline Benato
Host Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
Associated research grant:14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?, AP.TEM
Associated scholarship(s):22/12668-5 - Exploring visual analytics for supporting the user in active learning, BE.EP.DR

Abstract

Machine Learning models can be very effective when the number of labeled training samples is high. In some areas, such as Medicine and Biology, large labeled training sets are very difficult to be obtained, given that the manual annotation of such datasets is time-consuming and requires specialists. In general, data annotation based on the visual inspection (supervision) of each training sample (object) is a laborious process, especially when the number of required samples is large. In order to mitigate user effort in data annotation, many studies have adopted active learning techniques in which an apprentice classifier suggests informative samples for user supervision. It is expected that the classifier, retrained with those additional annotated samples, performs better in a next iteration. However, finding a small and effective set of informative samples for user supervision may be difficult since it also depends on the feature space. As a result, the number of active learning iterations (number of supervised samples) and user involvement can still be high. With similar aim, we have presented interactive data annotation techniques guided by feature projection as part of the Master's thesis of the candidate. In these works, the user can visualize supervised (small set) and unsupervised (large set) training samples on a 2D projection space and propagate labels to the unsupervised ones, with and without assistance of a pattern classifier, but with no further object supervision. In this Doctoral proposal, we intend to extend our previous work by investigating and developing the combination of visual analytics, feature learning, and active learning techniques for the design of more effective image classification systems with minimum user effort in data annotation. The proposal also includes a period abroad at the University of Utrecht under the supervision of Prof. Alexandru Telea --- a recognized expert in Visual Analytics.

News published in Agência FAPESP Newsletter about the scholarship:
More itemsLess items
Articles published in other media outlets ( ):
More itemsLess items
VEICULO: TITULO (DATA)
VEICULO: TITULO (DATA)

Scientific publications (6)
(The scientific publications listed on this page originate from the Web of Science or SciELO databases. Their authors have cited FAPESP grant or fellowship project numbers awarded to Principal Investigators or Fellowship Recipients, whether or not they are among the authors. This information is collected automatically and retrieved directly from those bibliometric databases.)
BENATO, BARBARA C.; TELEA, ALEXANDRA C.; FALCAO, ALEXANDRE X.; IEEE COMP SOC. Iterative Pseudo-Labeling with Deep Feature Annotation and Confidence-Based Sampling. 2021 34TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2021), v. N/A, p. 7-pg., . (19/10705-8, 14/12236-1)
BENATO, BARBARA C.; FALCAO, ALEXANDRE X.; TELEA, ALEXANDRU C.. Measuring the quality of projections of high-dimensional labeled data. COMPUTERS & GRAPHICS-UK, v. 116, p. 11-pg., . (22/12668-5, 14/12236-1, 19/10705-8)
BENATO, BARBARA C.; GOMES, JANCARLO F.; TELEA, ALEXANDRU C.; FALCAO, ALEXANDRE XAVIER. Semi-supervised Deep Learning Based on Label Propagation in a 2D Embedded Space. PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2021, v. 12702, p. 11-pg., . (19/10705-8, 14/12236-1)
BENATO, BARBARA C.; FALCAO, ALEXANDRE X.; TELEA, ALEXANDRU C.. Linking Data Separation, Visual Separation, Classifier Performance Using Multidimensional Projections. COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VISIGRAPP 2023, v. 2103, p. 27-pg., . (22/12668-5, 19/10705-8, 14/12236-1)
BENATO, BARBARA C.; GROSU, CRISTIAN; FALCAO, ALEXANDRE X.; TELEA, ALEXANDRU C.. Human-in-the-loop: Using classifier decision boundary maps to improve pseudo labels. COMPUTERS & GRAPHICS-UK, v. 124, p. 13-pg., . (13/07375-0, 22/12668-5, 19/10705-8, 23/14427-8)
DE SOUZA, ITALOS ESTILON; BENATO, BARBARA C.; FALCAO, ALEXANDRE XAVIER; IEEE. Feature Learning from Image Markers for Object Delineation. 2020 33RD SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2020), v. N/A, p. 8-pg., . (14/12236-1, 19/10705-8)
Academic Publications
(References retrieved automatically from State of São Paulo Research Institutions)
BENATO, Bárbara Caroline. Pseudo rotulação e classificação de dados de alta dimensionalidade usando analítica visual. 2024. Doctoral Thesis - Universidade Estadual de Campinas (UNICAMP). Instituto de Computação Campinas, SP.