Graph-based bag-of-words for classification

Author(s)

Silva, Fernanda B. ^{[1, 2]} ; Werneck, Rafael de O. ^[1] ; Goldenstein, Siome ^[1] ; Tabbone, Salvatore ^[3] ; Torres, Ricardo da S. ^[1]

Affiliation

^[1] Univ Campinas Unicamp, Inst Comp IC, RECOD Lab, Ave Albert Einstein 1251, BR-13083852 Campinas, SP - Brazil

^[2] Microsoft ATL, Rio De Janeiro - Brazil

^[3] Univ Lorraine, LORIA, UMR 7503, BP 239, F-54506 Vandoeuvre Les Nancy - France

• Document type: Journal article
• Source: PATTERN RECOGNITION; v. 74, p. 266-285, FEB 2018.
• Web of Science Citations: 16

Abstract

This paper introduces the Bag of Graphs (BoG), a Bag-of-Words model that encodes in graphs the local structures of a digital object. We present a formal definition, introducing concepts and rules that make this model flexible and adaptable for different applications. We define two BoG-based methods Bag of Singleton Graphs (BoSG) and Bag of Visual Graphs (BoVG), which create vector representations for graphs and images, respectively. We evaluate the Bag of Singleton Graphs (BoSG) for graph classification on four datasets of the IAM repository, obtaining significant results in accuracy and execution time. The method Bag of Visual Graphs (BoVG) is evaluated for image classification on Caltech and ALOI datasets, and for remote sensing image classification on images of Monte Santo and Campinas datasets. This framework opens possibilities for retrieval, classification, and clustering tasks on large datasets that use graph-based representations impractical before due to the complexity of inexact graph matching. (C) 2017 Elsevier Ltd. All rights reserved. (AU)

• FAPESP's process: 16/18429-1 - A bag-of-graphs approach for cross-modal representations
• Grantee: Rafael de Oliveira Werneck
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 12/50468-6 - Vision for the blind: translating 3D visual concepts into 3D auditory clues
• Grantee: Siome Klein Goldenstein
• Support Opportunities: Research Grants - Research Partnership for Technological Innovation - PITE
• FAPESP's process: 13/11378-4 - Applying bag of visual graphs approach for symbol spotting
• Grantee: Fernanda Brandão Silva
• Support Opportunities: Scholarships abroad - Research Internship - Master's degree
• FAPESP's process: 13/50155-0 - Combining new technologies to monitor phenology from leaves to ecosystems
• Grantee: Leonor Patricia Cerdeira Morellato
• Support Opportunities: Research Program on Global Climate Change - University-Industry Cooperative Research (PITE)
• FAPESP's process: 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?
• Grantee: Alexandre Xavier Falcão
• Support Opportunities: Research Projects - Thematic Grants
• FAPESP's process: 12/16172-2 - The Use of Graphs for Coding the Spatial Distribution of Visual Words and their use for Searching and Classification of Images in Large Collections
• Grantee: Fernanda Brandão Silva
• Support Opportunities: Scholarships in Brazil - Master
• FAPESP's process: 13/50169-1 - Towards an understanding of tipping points within tropical South American biomes
• Grantee: Ricardo da Silva Torres
• Support Opportunities: Research Grants - Research Partnership for Technological Innovation - PITE