Color-texture classification based on spatio-spectral complex network representations

Author(s)

Ribas, Lucas C. ; Scabini, Leonardo F. S. ; Condori, Rayner H. M. ; Bruno, Odemir M.

• Document type: Journal article
• Source: PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS; v. 635, p. 15-pg., 2024-01-19.

Abstract

This paper proposes a method for color -texture analysis by learning spatio-spectral representations from a complex network framework using the Randomized Neural Network (RNN). We model the color -texture image as a directed complex network based on the Spatio-Spectral Network (SSN) model, which considers within -channel connections in its topology to represent the spatial characteristics and spectral patterns covered by between -channel links. The insight behind the method is that complex topological features from the SSN can be embedded by a simple and fast neural network model for color -texture classification. Thus, we investigate how to effectively use the RNN to analyze and represent the spatial and spectral patterns from the SSN. We use the SSN vertex measurements to train the RNN to predict the dynamics of the complex network evolution and adopt the learned weights of the output layer as descriptors. Classification experiments in four datasets show the proposed method produces a very discriminative representation. The results demonstrate that our method obtains accuracies higher than several literature techniques, including deep convolutional neural networks. The proposed method also showed to be promising for plant species recognition, achieving high accuracies in this task. This performance indicates that the proposed approach can be employed successfully in computer vision applications. (AU)

• FAPESP's process: 23/04583-2 - Pattern recognition in images based on artificial neural networks and complex systems: from handcrafted descriptor extraction to automated learning
• Grantee: Lucas Correia Ribas
• Support Opportunities: Regular Research Grants
• FAPESP's process: 19/07811-0 - Artificial neural networks and complex networks: an integrative study of topological properties and pattern recognition
• Grantee: Leonardo Felipe dos Santos Scabini
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 21/09163-6 - Network science for optimizing artificial neural networks on computer vision
• Grantee: Leonardo Felipe dos Santos Scabini
• Support Opportunities: Scholarships abroad - Research Internship - Doctorate
• FAPESP's process: 18/22214-6 - Towards a convergence of technologies: from sensing and biosensing to information visualization and machine learning for data analysis in clinical diagnosis
• Grantee: Osvaldo Novais de Oliveira Junior
• Support Opportunities: Research Projects - Thematic Grants