Advanced search
Start date
Betweenand


Clustered and deep echo state networks for signal noise reduction

Full text
Author(s):
de Oliveira Junior, Laercio ; Stelzer, Florian ; Zhao, Liang
Total Authors: 3
Document type: Journal article
Source: MACHINE LEARNING; v. 111, n. 8, p. 20-pg., 2022-03-11.
Abstract

Echo State Networks (ESNs) are Recurrent Neural Networks with fixed input and internal (hidden) weights, and adaptable output weights. The hidden part of an ESN can be considered as a discrete-time dynamical system, called reservoir. In classical ESNs, the internal connections are obtained from an Erdos-Renyi graph. A recent study proposed ESNs with clustered adjacency matrices (CESNs), where the clusters are either Erdos-Renyi graphs or Barabasi-Albert-like graphs. In this work, we investigate the effectiveness of CESNs and apply them for signal denoising. In addition, we introduce and study deep CESNs with multiple clustered layers. We found that CESNs and deep CESNs can compete with deep ESNs for all tasks that we considered. (AU)

FAPESP's process: 15/50122-0 - Dynamic phenomena in complex networks: basics and applications
Grantee:Elbert Einstein Nehrer Macau
Support Opportunities: Research Projects - Thematic Grants
FAPESP's process: 19/07665-4 - Center for Artificial Intelligence
Grantee:Fabio Gagliardi Cozman
Support Opportunities: Research Grants - Research Program in eScience and Data Science - Research Centers in Engineering Program