Advanced search
Start date
(Reference retrieved automatically from Web of Science through information on FAPESP grant and its corresponding number as mentioned in the publication by the authors.)

IFTrace: Video segmentation of deformable objects using the Image Foresting Transform

Full text
Minetto, R. [1] ; Spina, T. V. [1] ; Falcao, A. X. [1] ; Leite, N. J. [1] ; Papa, J. P. [2] ; Stolfi, J. [1]
Total Authors: 6
[1] Univ Estadual Campinas, UNICAMP, Inst Comp, Campinas, SP - Brazil
[2] Univ Estadual Paulista, Dept Comp, Bauru - Brazil
Total Affiliations: 2
Document type: Journal article
Source: COMPUTER VISION AND IMAGE UNDERSTANDING; v. 116, n. 2, p. 274-291, FEB 2012.
Web of Science Citations: 4

We introduce IFTrace, a method for video segmentation of deformable objects. The algorithm makes minimal assumptions about the nature of the tracked object: basically, that it consists of a few connected regions, and has a well-defined border. The objects to be tracked are interactively segmented in the first frame of the video, and a set of markers is then automatically selected in the interior and immediate surroundings of the object. These markers are then located in the next frame by a combination of KLT feature finding and motion extrapolation. Object boundaries are then identified from these markers by the Image Foresting Transform (IFT). These steps are repeated for all subsequent frames until the end of the movie. Thanks to the IFT and a special boundary detection operator, IFTrace can reliably track deformable objects in the presence of partial and total occlusions, camera motion, lighting and color changes, and other complications. Tests on real videos show that the IFT is better suited to this task than Graph-Cut methods, and that IFTrace is more robust than other state-of-the art algorithms - namely, the OpenCV Snake and Cam-Shift algorithms, Hess's Particle-Filter, and Zhong and Chang's method based on spatio-temporal consistency. (C) 2011 Elsevier Inc. All rights reserved. (AU)

FAPESP's process: 07/52015-0 - Approximation methods for visual computing
Grantee:Jorge Stolfi
Support type: Research Projects - Thematic Grants
FAPESP's process: 09/11908-8 - User-steered editing of natural images based on the image foresting transform
Grantee:Thiago Vallin Spina
Support type: Scholarships in Brazil - Master