Advanced search
Start date
Betweenand


Measuring the quality of projections of high-dimensional labeled data

Full text
Author(s):
Benato, Barbara C. ; Falcao, Alexandre X. ; Telea, Alexandru C.
Total Authors: 3
Document type: Journal article
Source: COMPUTERS & GRAPHICS-UK; v. 116, p. 11-pg., 2023-11-01.
Abstract

Dimensionality reduction techniques, also called projections, are one of the main tools for visualizing high-dimensional data. To compare such techniques, several quality metrics have been proposed. However, such metrics may not capture the visual separation among groups/classes of samples in a projection, i.e., having groups of similar (same label) points far from other (distinct label) groups of points. For this, we propose a pseudo-labeling mechanism to assess visual separation using the performance of a semi-supervised optimum-path forest classifier (OPFSemi), measured by Cohen's Kappa. We argue that lower label propagation errors by OPFSemi in projections are related to higher data/visual separation. OPFSemi explores local and global information of data distribution when computing optimum connectivity between samples in a projection for label propagation. It is parameter-free, fast to compute, easy to implement, and generically handles any high-dimensional quantitative labeled dataset and projection technique. We compare our approach with four commonly used scalar metrics in the literature for 18 datasets and 39 projection techniques. Our results consistently show that our proposed metric consistently scores values in line with the perceived visual separation, surpassing existing projection-quality metrics in this respect. (c) 2023 Elsevier Ltd. All rights reserved. (AU)

FAPESP's process: 22/12668-5 - Exploring visual analytics for supporting the user in active learning
Grantee:Bárbara Caroline Benato
Support Opportunities: Scholarships abroad - Research Internship - Doctorate
FAPESP's process: 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?
Grantee:Alexandre Xavier Falcão
Support Opportunities: Research Projects - Thematic Grants
FAPESP's process: 19/10705-8 - Visual Active Learning guided by Feature Projections
Grantee:Bárbara Caroline Benato
Support Opportunities: Scholarships in Brazil - Doctorate