An online adaptive classifier ensemble for mining non-stationary data streams

Author(s)

Verdecia-Cabrera, Alberto ^[1] ; Blanco, Isvani Frias ^[2] ; Carvalho, Andre C. P. L. F. ^[2]

Affiliation

^[1] Univ Cent Las Villas, Santa Clara - Cuba

^[2] Univ Sao Paulo, Sao Paulo - Brazil

• Document type: Journal article
• Source: Intelligent Data Analysis; v. 22, n. 4, p. 787-806, 2018.
• Web of Science Citations: 0

Abstract

Many real-world situations constantly generate concept-drifting data streams at high speed. These situations demand adaptive algorithms able to learn online in accordance with the most recent target function (concept). This paper presents Online Adaptive Classifier Ensemble, a new ensemble algorithm able to learn from concept-drifting data streams. The proposed algorithm uses a change detection mechanism in each base classifier in order to handle possible changes in the underlying target function. Each base classifier in the ensemble can alternate between three different stages during the learning process: stable, warning and drift. In a stable stage, the underlying target function is supposed to remain constant, and the corresponding base classifier is updated with each incoming training instance. In a warning stage, a possible change in the target function can be starting to occur, and an alternative base classifier is created and trained together with the other base classifiers. The alternative classifier is added to the ensemble if the drift stage is reached. The new algorithm is compared with various state-of-the-art ensemble algorithms for online learning. Empirical studies show that this proposal is an effective alternative for learning from non-stationary data streams. (AU)

• FAPESP's process: 15/03355-0 - Novelty detection by machine learning
• Grantee: Isvani Inocencio Frías Blanco
• Support Opportunities: Scholarships in Brazil - Post-Doctoral
• FAPESP's process: 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry
• Grantee: Francisco Louzada Neto
• Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC