DSTARS: A multi-target deep structure for tracking asynchronous regressor stacking

Autor(es)

Mastelini, Saulo Martiello ^[1] ; Santana, Everton Jose ^[2] ; Cerri, Ricardo ^[3] ; Barbon Jr, Sylvio

Afiliação do(s) autor(es)

^[1] Univ Sao Paulo, Inst Math & Comp Sci, BR-13566590 Sao Carlos - Brazil

^[2] State Univ Londrina UEL, Dept Comp Sci, BR-86057970 Londrina, Parana - Brazil

^[3] Fed Univ Sao Carlos UFSCar, Dept Comp Sci, BR-13565905 Sao Carlos - Brazil

• Tipo de documento: Artigo Científico
• Fonte: APPLIED SOFT COMPUTING; v. 91, JUN 2020.
• Citações Web of Science: 0

Resumo

Several applications of supervised learning involve the prediction of multiple continuous target variables from a dataset. When the target variables exhibit statistical dependencies among them, a multi-target regression (MTR) modelling permits to improve the predictive performance in comparison to induce a separate model for each target. Apart from describing the dependencies among the targets, the MTR methods could offer better performance and less overfitting than traditional single-target (ST) methods. A group of MTR methods have addressed this demand, but there are still many possibilities for further improvements. This paper presents a novel MTR method called Deep Structure for Tracking Asynchronous Regressor Stacking (DSTARS), which overcomes some existing gaps in the current solutions. DSTARS extends the Stacked Single-Target (SST) approach by combining multiple stacked regressors into a deep structure. In this sense, it is able to boost the predictive performance by successively improving the predictions for the targets. Besides, DSTARS exploits the dependency of each target individually by tracking an asynchronous number of stacked regressors. Additionally, our proposal explores the inter-targets dependencies by exposing and measuring them through a nonlinear metric of variable importance. We compared DSTARS to SST, Ensemble of Regressor Chains (ERC) and Multi-objective Random Forest (MORF). Also, the ST strategy with different algorithms was used to compute independent regressions for each target. We used Random Forest (RF) and Support Vector Machine (SVM) as base-learners to investigate the prediction capability of algorithms belonging to different machine learning paradigms. The experiments carried out on eighteen diverse datasets showed that the proposed method was significantly better than the other compared approaches. (AU)

• Processo FAPESP: 13/07375-0 - CeMEAI - Centro de Ciências Matemáticas Aplicadas à Indústria
• Beneficiário: Francisco Louzada Neto
• Modalidade de apoio: Auxílio à Pesquisa - Centros de Pesquisa, Inovação e Difusão - CEPIDs
• Processo FAPESP: 18/07319-6 - Mineração multi-alvos em fluxos de dados
• Beneficiário: Saulo Martiello Mastelini
• Modalidade de apoio: Bolsas no Brasil - Doutorado