Busca avançada
Ano de início
Entree


Fast and lightweight binary and multi-branch Hoeffding Tree Regressors

Texto completo
Autor(es):
Mastelini, Saulo Martiello ; Montiel, Jacob ; Gomes, Heitor Murilo ; Bifet, Albert ; Pfahringer, Bernhard ; de Carvalho, Andre C. P. L. F. ; Xue, B ; Pechenizkiy, M ; Koh, YS
Número total de Autores: 9
Tipo de documento: Artigo Científico
Fonte: 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS ICDMW 2021; v. N/A, p. 9-pg., 2021-01-01.
Resumo

Incremental Hoeffding Tree Regressors (HTR) are powerful non-linear online learning tools. However, the commonly used strategy to build such structures limits their applicability to real-time scenarios. In this paper, we expand and evaluate Quantization Observer (QO), a feature discretization-based tool to speed up incremental regression tree construction and save memory resources. We enhance the original QO proposal to create multi-branch trees when dealing with numerical attributes, creating a mix of interval and binary splits rather than binary splits only. We evaluate the multi-branch and strictly binary QO-based HTRs against other tree-building strategies in an extensive experimental setup of 15 data streams. In general, the QO-based HTRs are as accurate as traditional HTRs, incurring one-third of training time at only a fraction of the memory resource usage. The obtained numerical multi-branch HTRs are shallower than the strictly binary ones, significantly faster to train, and they keep predictive performance similar to the traditional incremental trees. (AU)

Processo FAPESP: 18/07319-6 - Mineração multi-alvos em fluxos de dados
Beneficiário:Saulo Martiello Mastelini
Modalidade de apoio: Bolsas no Brasil - Doutorado