Human-in-the-loop: Using classifier decision boundary maps to improve pseudo labels

Author(s)

Benato, Barbara C. ; Grosu, Cristian ; Falcao, Alexandre X. ; Telea, Alexandru C.

• Document type: Journal article
• Source: COMPUTERS & GRAPHICS-UK; v. 124, p. 13-pg., 2024-09-05.

Abstract

For classification tasks, several strategies aim to tackle the problem of not having sufficient labeled data, usually by automatic labeling or by fully passing this task to a user. Automatic labeling is simple to apply but can fail handling complex situations where human insights maybe required to decide the correct labels. Conversely, manual labeling leverages the expertise of specialists but may waste precious effort which could be handled by automatic methods. More specifically, automatic solutions could be improved by combining an active learning loop with manual labeling assisted by visual depictions of a classifier's behavior. We propose to include the human in the labeling loop by using manual labeling in feature spaces produced by a deep feature annotation (DeepFA) technique. To assist manual labeling, we provide users with visual insights on the classifier's decision boundaries. Finally, we use the manual and automatically computed labels jointly to retrain the classifier in an active learning (AL) loop scheme. Experiments using a toy and a real-world application dataset show that our proposed combination of manual labeling supported by visualization of decision boundaries and automatic labeling can yield a significant increase in classifier performance with a quite limited user effort. (AU)

• FAPESP's process: 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry
• Grantee: Francisco Louzada Neto
• Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC
• FAPESP's process: 22/12668-5 - Exploring visual analytics for supporting the user in active learning
• Grantee: Bárbara Caroline Benato
• Support Opportunities: Scholarships abroad - Research Internship - Doctorate
• FAPESP's process: 19/10705-8 - Visual Active Learning guided by Feature Projections
• Grantee: Bárbara Caroline Benato
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 23/14427-8 - Data Science for Smart Industry (CDII)
• Grantee: José Alberto Cuminato
• Support Opportunities: Research Grants - Research Centers in Engineering Program