Learning Representations using artificial neural networks and complex networks with applications in sensors and biosensors

• Grant number: 21/07289-2
• Support Opportunities: Scholarships in Brazil - Post-Doctoral
• Start date: February 01, 2022
• End date: August 14, 2022
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Odemir Martinez Bruno
• Grantee: Lucas Correia Ribas
• Host Institution: Instituto de Física de São Carlos (IFSC). Universidade de São Paulo (USP). São Carlos , SP, Brazil
• Associated research grant: 18/22214-6 - Towards a convergence of technologies: from sensing and biosensing to information visualization and machine learning for data analysis in clinical diagnosis, AP.TEM

Abstract

Great efforts have been made by researchers from different areas to develop sensors and biosensors for various purposes such as early cancer diagnosis, detection of contamination in food/water, etc. In this sense, many researchers have focused on the development of new low-cost detection and diagnosis strategies. Particularly, promising results have been achieved using machine learning techniques and computer vision in sensory unit images. Although many works have used computer vision techniques in biological images, so far there are not many studies in the literature that explore sensor and biosensor images. This postdoctoral project aims to develop new representation learning approaches for image characterization using artificial neural networks (ANNs) and complex networks with direct application to biosensor and sensor images. Regarding the research aspects of computational methods for image characterization, we intend to investigate ways to learn representations (ie, feature vectors) with ANNs using as input source attributes from (or the own) image or the modeled complex network of combined mode. In particular, complex networks stand out for their ability to model complex texture patterns that we observed in sensory unit images.Regarding the ANNs, besides the deep neural networks, we will use the random neural networks due to their simplicity, high predictive performance and fast learning algorithm. We also highlight the \textit{vision transformers} architecture that, despite the promising results in recent works of scene/object recognition, have not yet been fully explored in problems of texture and microscopy image analysis and complex networks. The computational methods developed will be used to characterize the images of sensory units to design new strategies for applications such as early diagnosis of cancer and detection of viruses or contaminations. Such data will be generated and provided by the various collaborators in the thematic project financed by FAPESP (process, 2018/22214-6) in which this post-doctorate project is linked. We expect that this research will result in relevant contributions in the computational scope with new techniques for image analysis and related to physical chemistry and applications with new detection and diagnosis strategies. It should be noted that this second contribution is congruent with the objectives of the thematic project.

Scientific publications

(4)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

DE CASTRO, LUCAS D. C.; SCABINI, LEONARDO; RIBAS, LUCAS C.; BRUNO, ODEMIR M.; OLIVEIRA JR, OSVALDO N.. Machine learning and image processing to monitor strain and tensile forces with mechanochromic sensors. EXPERT SYSTEMS WITH APPLICATIONS, v. 212, p. 7-pg., 2023-02-01. (20/02938-0, 16/18809-9, 18/22214-6, 14/08026-1, 21/07289-2, 19/07811-0)

RIBAS, LUCAS C.; SCABINI, LEONARDO; BRUNO, ODEMIR M.; IEEE. A complex network approach for fish species recognition based on otolith shape. 2022 ELEVENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), v. N/A, p. 5-pg., 2022-01-01. (21/07289-2, 16/18809-9, 18/22214-6)

ZIELINSKI, KALLIL M. C.; RIBAS, LUCAS C.; SCABINI, LEONARDO F. S.; BRUNO, ODEMIR M.; IEEE. Complex Texture Features Learned by Applying Randomized Neural Network on Graphs. 2022 ELEVENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), v. N/A, p. 6-pg., 2022-01-01. (14/08026-1, 21/07289-2, 16/18809-9, 18/22214-6)

SCABINI, LEONARDO; ZIELINSKI, KALLIL M.; RIBAS, LUCAS C.; GONCALVES, WESLEY N.; DE BAETS, BERNARD; BRUNO, ODEMIR M.. RADAM: Texture recognition through randomized aggregated encoding of deep activation maps. PATTERN RECOGNITION, v. 143, p. 13-pg., 2023-11-01. (22/03668-1, 21/09163-6, 18/22214-6, 21/07289-2, 21/08325-2, 19/07811-0)