Feature Adaptive Filtering: Exploiting Hidden Sparsity

Author(s)

Yazdanpanah, Hamed ^[1] ; Diniz, Paulo S. R. ^{[2, 3]} ; Lima, Markus V. S. ^{[2, 3]}

Affiliation

^[1] Univ Sao Paulo, Dept Comp Sci, BR-05508090 Sao Paulo, SP - Brazil

^[2] Univ Fed Rio de Janeiro, COPPE, DE LDEE Poli, BR-21941901 Rio De Janeiro, RJ - Brazil

^[3] Univ Fed Rio de Janeiro, COPPE, Program Elect Engn, BR-21941901 Rio De Janeiro, RJ - Brazil

• Document type: Journal article
• Source: IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS; v. 67, n. 7, p. 2358-2371, JUL 2020.
• Web of Science Citations: 1

Abstract

We have been witnessed a growing research activity to advance new strategies to detect and exploit underlying sparsity in the parameters of physical models. In many cases, the sparsity is not explicit in the relations among the parameter coefficients requiring some suitable tools to reveal the potential sparsity. This work proposes a family of adaptive filtering algorithms, aimed at exposing some hidden features of the unknown parameters. Although the basic idea applies to any algorithm, we will concentrate the work in the LMS-type algorithms, giving rise to a family collectively named as Feature LMS (F-LMS) algorithms. These algorithms increase the convergence speed and reduce the steady-state mean-squared error, in comparison with the classical LMS solution. The main idea is to apply linear transformations, through the so-called feature matrices, to reveal the sparsity hidden in the coefficient vector, followed by a sparsity-promoting penalty function to exploit the exposed sparsity. For illustration, a few F-LMS algorithms for lowpass, bandpass, and highpass systems are introduced by using simple feature matrices that require either only simple operations or can learn the features. Simulations and real-life experiments demonstrate that the F-LMS algorithms bring about several performance improvements whenever the unknown sparsity of parameters is exposed. (AU)

• FAPESP's process: 19/06280-1 - Integration, transformation, dataset augmentation and quality control for intermediate representation
• Grantee: Hamed Yazdanpanah
• Support Opportunities: Scholarships in Brazil - Post-Doctoral
• FAPESP's process: 15/22308-2 - Intermediate representations in Computational Science for knowledge discovery
• Grantee: Roberto Marcondes Cesar Junior
• Support Opportunities: Research Projects - Thematic Grants