Advanced search
Start date
Betweenand


Skeletal Similarity based Structural Performance Evaluation for Document Binarization

Full text
Author(s):
Monteiro Silva, Augusto Cesar ; Hirata, Nina S. T. ; Jiang, Xiaoyi ; IEEE COMP SOC
Total Authors: 4
Document type: Journal article
Source: 2020 17TH INTERNATIONAL CONFERENCE ON FRONTIERS IN HANDWRITING RECOGNITION (ICFHR 2020); v. N/A, p. 6-pg., 2020-01-01.
Abstract

Document image binarization algorithms are usually evaluated by a pixelwise comparison. Such metrics can be misleading and do not assess the overall structure of the text in the image, thus they do not measure the character recognition capability of the binarized image. In this paper we propose the use of metrics, based on skeleton comparisons, to evaluate structural consistency of the strokes that better correspond to character readability in the binarized image. This approach divides the skeleton of two binary images to be compared (e.g. binarization result and ground truth) in small segments and measures curve similarity between those segments. We conducted experiments with manually generated data with small distortions in the image, which greatly affect common pixelwise metrics but do not hinder the readability of the text. We also binarized images of well-known document binarization datasets using classical and state-of-the-art algorithms such as Otsu's and deep learning methods. On both manually generated and real data it could be demonstrated, amongst others, that the skeletal similarity metrics are more consistent than the pixelwise comparison regarding small character distortions and better capture the readability of the binarized image. Skeletal similarity metrics can be used to complement the pixelwise comparison towards multifaceted performance evaluation for document binarization. (AU)

FAPESP's process: 15/22308-2 - Intermediate representations in Computational Science for knowledge discovery
Grantee:Roberto Marcondes Cesar Junior
Support Opportunities: Research Projects - Thematic Grants
FAPESP's process: 19/07361-5 - Structural information in image-to-image transformation learning processes
Grantee:Augusto César Monteiro Silva
Support Opportunities: Scholarships abroad - Research Internship - Master's degree
FAPESP's process: 18/00477-5 - Learning image-to-image transformations
Grantee:Augusto César Monteiro Silva
Support Opportunities: Scholarships in Brazil - Master
FAPESP's process: 17/25835-9 - Understanding images and deep learning models
Grantee:Nina Sumiko Tomita Hirata
Support Opportunities: Research Grants - Research Partnership for Technological Innovation - PITE