A pseudo-parabolic diffusion model to enhance deep neural texture features

Autor(es)

Florindo, Joao B. ; Abreu, Eduardo

• Tipo de documento: Artigo Científico
• Fonte: MULTIMEDIA TOOLS AND APPLICATIONS; v. N/A, p. 22-pg., 2023-06-29.

Resumo

In this work, we propose a methodology for texture recognition. The combination of deep learning with texture encoding techniques has demonstrated to be a powerful strategy to solve this problem. However, one of such encoding classically used in texture images, which are PDE operators, has not been explored in deep learning frameworks. Based on that, here we introduce a pseudo-parabolic diffusion operator to the pipeline of a convolutional neural network (CNN). The method is divided into 4 major stages: 1) application of the pseudo-parabolic operator to the image; 2) use of the resulting image as input to a pre-trained CNN; 3) extraction of local features from the last convolutional layer and pooling by Fisher vectors; 4) classification of the pooled features. Our approach is compared in a texture classification task and outperforms, in terms of classification accuracy, several state-of-the-art solutions. For example, in the challenging benchmark datasets KTH2b and FMD, the proposed method achieves classification accuracy of 79% and 81.8%, respectively. From the numerical viewpoint, we also highlight the key approximation and algorithmic aspects of our computational pseudo-parabolic diffusion modeling into the pipeline of a CNN to enhance deep neural texture features. In particular, the advantage over the plain CNN architecture is substantial. Such interesting performance can be justified by the capacity of the pseudo-parabolic operator to remove spurious noise while preserving important discontinuity information on the texture. The results also suggest the potential of our approach in real-world application, as attested on a practical application to the identification of plant species. In this specific task, our method achieves an accuracy of 94% and outperforms the state-of-the-art results. This is especially the case when we do not have access to a large amount of data for training and when the computational resources are limited, as our method do not involve any fine tuning. (AU)

• Processo FAPESP: 20/01984-8 - Introduzindo elementos de geometria fractal em redes convolucionais profundas: uma aplicação ao reconhecimento e categorização do Câncer de Pulmão
• Beneficiário: Joao Batista Florindo
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Processo FAPESP: 20/09838-0 - BI0S - Brazilian Institute of Data Science
• Beneficiário: João Marcos Travassos Romano
• Modalidade de apoio: Auxílio à Pesquisa - Programa Centros de Pesquisa em Engenharia