SnooperText: A text detection system for automatic scenes indexing of urban scenes

Autor(es)

Minetto, Rodrigo ^[1] ; Thome, Nicolas ^[2] ; Cord, Matthieu ^[2] ; Leite, Neucimar J. ^[3] ; Stolfi, Jorge ^[3]

Afiliação do(s) autor(es)

^[1] Univ Fed Parana, DAINF, BR-80060000 Curitiba, Parana - Brazil

^[2] Univ Paris 06, Lab Informat Paris 6 LIP6, Paris - France

^[3] Univ Estadual Campinas, Inst Comp, Campinas, SP - Brazil

• Tipo de documento: Artigo Científico
• Fonte: COMPUTER VISION AND IMAGE UNDERSTANDING; v. 122, p. 92-104, MAY 2014.
• Citações Web of Science: 29

Resumo

We describe SNOOPERTEXT, an original detector for textual information embedded in photos of building facades (such as names of stores, products and services) that we developed for the iTowns urban geographic information project. SNOOPERTEXT locates candidate characters by using toggle-mapping image segmentation and character/non-character classification based on shape descriptors. The candidate characters are then grouped to form either candidate words or candidate text lines. These candidate regions are then validated by a text/non-text classifier using a HOG-based descriptor specifically tuned to single-line text regions. These operations are applied at multiple image scales in order to suppress irrelevant detail in character shapes and to avoid the use of overly large kernels in the segmentation. We show that SNOOPERTEXT outperforms other published state-of-the-art text detection algorithms on standard image benchmarks. We also describe two metrics to evaluate the end-to-end performance of text extraction systems, and show that the use of SNOOPERTEXT as a pre-filter significantly improves the performance of a general-purpose OCR algorithm when applied to photos of urban scenes. (C) 2013 Elsevier Inc. All rights reserved. (AU)

• Processo FAPESP: 07/54201-6 - Análise de vídeos digitais: problemas de segmentação espaço-temporal, detecção de movimentos baseados em fluxo ótico e seleção de frames representativos
• Beneficiário: Rodrigo Minetto
• Modalidade de apoio: Bolsas no Brasil - Doutorado
• Processo FAPESP: 07/52015-0 - Métodos de aproximação para computação visual
• Beneficiário: Jorge Stolfi
• Modalidade de apoio: Auxílio à Pesquisa - Temático