Energy-based function to evaluate data stream clustering

Author(s)

Albertini, Marcelo Keese ^[1] ; de Mello, Rodrigo Fernandes ^[2]

Affiliation

^[1] Univ Fed Uberlandia, Fac Comp, Uberlandia, MG - Brazil

^[2] Univ Sao Paulo, Dept Comp Sci, Sao Carlos, SP - Brazil

• Document type: Journal article
• Source: Advances in Data Analysis and Classification; v. 7, n. 4, p. 435-464, DEC 2013.
• Web of Science Citations: 5

Abstract

Severe constraints imposed by the nature of endless sequences of data collected from unstable phenomena have pushed the understanding and the development of automated analysis strategies, such as data clustering techniques. However, current clustering validation approaches are inadequate to data streams due to they do not properly evaluate representation of behavior changes. This paper proposes a novel function to continuously evaluate data stream clustering inspired in Lyapunov energy functions used by techniques such as the Hopfield artificial neural network and the Bidirectional Associative Memory (Bam). The proposed function considers three terms: i) the intra-cluster distance, which allows to evaluate cluster compactness; ii) the inter-cluster distance, which reflects cluster separability; and iii) entropy estimation of the clustering model, which permits the evaluation of the level of uncertainty in data streams. A first set of experiments illustrate the proposed function applied to scenarios of continuous evaluation of data stream clustering. Further experiments were conducted to compare this new function to well-established clustering indices and results confirm our proposal reflects the same information obtained with external clustering indices. (AU)

• FAPESP's process: 11/19459-8 - Automatic adaptation for clustering data streams
• Grantee: Marcelo Keese Albertini
• Support Opportunities: Scholarships in Brazil - Post-Doctoral