Detecting and tracking leukocytes in intravital video microscopy using a Hessian-based spatiotemporal approach

Author(s)

Gregorio da Silva, Bruno C. ^[1] ; Carvalho-Tavares, Juliana ^[2] ; Ferrari, Ricardo J. ^[1]

Affiliation

^[1] Univ Fed Sao Carlos, Dept Comp, Sao Carlos, SP - Brazil

^[2] Univ Fed Minas Gerais, Dept Physiol & Biophys, Belo Horizonte, MG - Brazil

• Document type: Journal article
• Source: MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING; v. 30, n. 2, p. 815-839, APR 2019.
• Web of Science Citations: 0

Abstract

The leukocyte recruitment analysis is an important step to understand the interactions between leukocytes and endothelial cells in the microcirculation of living animals. Performed preferably by the intravital video microscopy technique, this procedure usually requires an expert visual analysis, which is prone to the inter- and intra-observer variability. Such problem claims, therefore, an automated method to detect and track these cells. To this end, we developed an approach that combines two different analyses: in the first (2D), all video frames are individually processed by using a blob-like structure detector to find the leukocyte centroids, while in the second (2D+t), a spatiotemporal image (created by stacking all video frames) is processed by a tubular-like structure detector, which is used to determine the leukocyte trajectories over time. For both analyses, the detectors are based on the relationship between Hessian matrix eigenvalues locally obtained from image sequences. Evaluation of the proposed approach was conducted by comparing our technique to the manual annotations using precision, recall and F1-score measures in two video sequences. The average results for these measures were, respectively, 0.84, 0.64, and 0.72 for the first video, and 0.84, 0.87, and 0.86 for the second. These results suggested that our proposed approach is comparable with manual annotations performed by the experts and has an excellent potential for use in real circumstances. Moreover, it can reduce the observer variabilities and the burden for visual analysis. (AU)

• FAPESP's process: 15/02232-1 - Automatic segmentation of magnetic resonance images of the human brain via deformable models guided by probabilistic atlas of 3D salient points
• Grantee: Ricardo José Ferrari
• Support Opportunities: Regular Research Grants
• FAPESP's process: 13/26171-6 - Detection and tracking of leukocytes in intravital microscopy images via spatial-temporal processing
• Grantee: Bruno César Gregório da Silva
• Support Opportunities: Scholarships in Brazil - Master