An iterative boosting-based ensemble for streaming data classification

Autor(es)

Bertini Junior, Joao Roberto ^[1] ; Nicoletti, Maria do Carmo ^{[2, 3]}

Afiliação do(s) autor(es)

^[1] Univ Estadual Campinas, Sch Technol, Rua Paschoal Marmo 1888, Limeira - Brazil

^[2] FACCAMP, Campo Limpo Paulista, SP - Brazil

^[3] Univ Fed Sao Carlos, Comp Sci Dept, Sao Carlos, SP - Brazil

• Tipo de documento: Artigo Científico
• Fonte: Information Fusion; v. 45, p. 66-78, JAN 2019.
• Citações Web of Science: 6

Resumo

Among the many issues related to data stream applications, those involved in predictive tasks such as classification and regression, play a significant role in Machine Learning (ML). The so-called ensemble-based approaches have characteristics that can be appealing to data stream applications, such as easy updating and high flexibility. In spite of that, some of the current approaches consider unsuitable ways of updating the ensemble along with the continuous stream processing, such as growing it indefinitely or deleting all its base learners when trying to overcome a concept drift. Such inadequate actions interfere with two inherent characteristics of data streams namely, its possible infinite length and its need for prompt responses. In this paper, a new ensemblebased algorithm, suitable for classification tasks, is proposed. It relies on applying boosting to new batches of data aiming at maintaining the ensemble by adding a certain number of base learners, which is established as a function of the current ensemble accuracy rate. The updating mechanism enhances the model flexibility, allowing the ensemble to gather knowledge fast to quickly overcome high error rates, due to concept drift, while maintaining satisfactory results by slowing down the updating rate in stable concepts. Results comparing the proposed ensemble-based algorithm against eight other ensembles found in the literature show that the proposed algorithm is very competitive when dealing with data stream classification. (AU)

• Processo FAPESP: 17/00219-3 - Classificação em fluxo de dados: lidando com anomalias, novidades e escassez de dados rotulados
• Beneficiário: João Roberto Bertini Junior
• Modalidade de apoio: Auxílio à Pesquisa - Regular