Using Machine Learning and Optical Microscopy Image Analysis of Immunosensors Made on Plasmonic Substrates: Application to Detect the SARS-CoV-2 Virus

Author(s)

Oiticica, Pedro R. A. ; Angelim, Monara K. S. C. ; Soares, Juliana C. ; Soares, Andrey C. ; Proenca-Modena, Jose L. ; Bruno, Odemir M. ; Oliveira Jr, Osvaldo N.

• Document type: Journal article
• Source: ACS SENSORS; v. N/A, p. 12-pg., 2025-02-17.

Abstract

In this article, we introduce a diagnostic platform comprising an optical microscopy image analysis system coupled with machine learning. Its efficacy is demonstrated in detecting SARS-CoV-2 virus particles at concentrations as low as 1 PFU (plaque-forming unit) per milliliter by processing images from an immunosensor on a plasmonic substrate. This high performance was achieved by classifying images with the support vector machine (SVM) algorithm and the MobileNetV3_small convolutional neural network (CNN) model, which attained an accuracy of 91.6% and a specificity denoted by an F1 score of 96.9% for the negative class. Notably, this approach enabled the detection of SARS-CoV-2 concentrations 1000 times lower than the limit of detection achieved with localized surface plasmon resonance (LSPR) sensing using the same immunosensors. It is also significant that a binary classification between control and positive classes using the MobileNetV3_small model and the random forest algorithm achieved an accuracy of 96.5% for SARS-CoV-2 concentrations down to 1 PFU/mL. At such low concentrations, straightforward screening of newly infected patients may be feasible. In supporting experiments, we verified that texture was the main contributor to the distinguishability of images taken at different SARS-CoV-2 concentrations, indicating that the combination of ML and image analysis may be applied to any biosensor whose detection mechanism is based on adsorption. (AU)

• FAPESP's process: 24/14742-3 - Development of hybrid electrospun nanofibers for sensor applications aiming at detecting contaminants in real samples
• Grantee: Pedro Ramon Almeida Oiticica
• Support Opportunities: Scholarships in Brazil - Post-Doctoral
• FAPESP's process: 18/22214-6 - Towards a convergence of technologies: from sensing and biosensing to information visualization and machine learning for data analysis in clinical diagnosis
• Grantee: Osvaldo Novais de Oliveira Junior
• Support Opportunities: Research Projects - Thematic Grants
• FAPESP's process: 20/16030-0 - Immunometabolic adaptation of tissue resident macrophages in health and disease
• Grantee: Pedro Manoel Mendes de Moraes Vieira
• Support Opportunities: Research Projects - Thematic Grants