| Full text | |
| Author(s): |
Loyola Lopes, Filipe
;
Dantas Mangussi, Arthur
;
Cardoso Pereira, Ricardo
;
Seoane Santos, Miriam
;
Henriques Abreu, Pedro
;
Carolina Lorena, Ana
Total Authors: 6
|
| Document type: | Journal article |
| Source: | IEEE ACCESS; v. 13, p. 14-pg., 2025-01-01. |
| Abstract | |
Missing data is a common challenge in real-world datasets and can arise for various reasons. This has led to the classification of missing data mechanisms as missing completely at random, missing at random, or missing not at random. Currently, the literature offers various algorithms for imputing missing data, each with advantages tailored to specific mechanisms and levels of missingness. This paper introduces a novel approach to missing data imputation using the well-established label propagation algorithm, named Label Propagation for Missing Data Imputation (LPMD). The method combines, weighs, and propagates known feature values to impute missing data. Experiments on benchmark datasets highlight its effectiveness across various missing data scenarios, demonstrating more stable results compared to baseline methods under different missingness mechanisms and levels. The algorithms were evaluated based on processing time, imputation quality (measured by mean absolute error), and impact on classification performance. A variant of the algorithm (LPMD2) generally achieved the fastest processing time compared to other five imputation algorithms from the literature, with speed-ups ranging from 0.7 to 23 times. The results of LPMD were also stable regarding the mean absolute error of the imputed values compared to their original counterparts, for different missing data mechanisms and rates of missing values. In real applications, missingness can behave according to different and unknown mechanisms, so an imputation algorithm that behaves stably for different mechanisms is advantageous. The results regarding ML models produced using the imputed datasets were also comparable to the baselines. (AU) | |
| FAPESP's process: | 21/06870-3 - Beyond algorithm selection: meta-learning for data and algorithm analysis and understanding |
| Grantee: | Ana Carolina Lorena |
| Support Opportunities: | Research Grants - Young Investigators Grants - Phase 2 |
| FAPESP's process: | 22/10553-6 - An unified approach for dealing with missing and noise data |
| Grantee: | Arthur Dantas Mangussi |
| Support Opportunities: | Scholarships in Brazil - Master |
| FAPESP's process: | 23/13688-2 - Um modelo Autoencoder para lidar com dados ausentes e com ruído |
| Grantee: | Arthur Dantas Mangussi |
| Support Opportunities: | Scholarships abroad - Research Internship - Master's degree |