Advanced search
Start date
Betweenand

Semantic information retrieval in large video databases

Abstract

Due to the rapid advances in data acquisition and transmission technologies, people are constantly inundated by information in form of digital video. In this scenario, there is a growing demand for efficient systems able to manage large volumes of video data and reduce the work and information overload when seeking a given content of interest. One of the main challenges in developing effective content-based video retrieval systems is to automatically identify semantic contents. For that, four barriers should be considered: (1) multimodal processing, (2) information fusion, (3) semantic learning and (4) query resolution. Numerous techniques have been proposed to overcome such issues. However, most of existing works involve computationally expensive methods. Currently, the development of effective and efficient techniques is an imperative need. In recent years, significant research efforts have been spent by academic and industry communities to make such solutions available to a wide range of devices and platforms. This is the context in which is inserted this research proposal. The goal of this research proposal is to advance the state of the art on semantic retrieval of digital videos. Recently, we introduced in the literature a unimodal video retrieval system designed for low computational power mobile devices. Based on the positive results from its application, we intend to extend the proposed system to take advantage of different data sources, i.e, to use multimodal information, thus improving its effectiveness. For that, we plan to exploit recent solutions on visual computing and machine intelligence aiming at combining different data sources efficiently. Finally, we expect to contribute greatly to the advances in this research field, since the results will be aggregated in a visual development interface, enabling the joint action of those solutions. (AU)

Articles published in Agência FAPESP Newsletter about the research grant:
More itemsLess items
Articles published in other media outlets ( ):
More itemsLess items
VEICULO: TITULO (DATA)
VEICULO: TITULO (DATA)

Scientific publications (20)
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
VALEM, LUCAS PASCOTTI; GUIMARAES PEDRONETTE, DANIEL CARLOS; ALMEIDA, JURANDY. Unsupervised similarity learning through Cartesian product of ranking references. PATTERN RECOGNITION LETTERS, v. 114, n. SI, p. 41-52, . (14/04220-8, 17/02091-4, 16/06441-7, 13/08645-0)
ALBERTON, BRUNA; TORRES, RICARDO DA S.; CANCIAN, LEONARDO F.; BORGES, BRUNO D.; ALMEIDA, JURANDY; MARIANO, GREICE C.; DOS SANTOS, JEFERSSON; CERDEIRA MORELLATOA, LEONOR PATRICIA. Introducing digital cameras to monitor plant phenology in the tropics: applications for conservation. PERSPECTIVES IN ECOLOGY AND CONSERVATION, v. 15, n. 2, p. 82-90, . (14/13354-8, 16/01413-5, 10/51307-0, 14/00215-0, 10/52113-5, 13/50155-0, 07/52015-0, 16/06441-7, 09/18438-7)
GUIMARAES PEDRONETTE, DANIEL CARLOS; VALEM, LUCAS PASCOTTI; ALMEIDA, JURANDY; TONES, RICARDO DA S.. Multimedia Retrieval Through Unsupervised Hypergraph-Based Manifold Ranking. IEEE Transactions on Image Processing, v. 28, n. 12, p. 5824-5838, . (14/50715-9, 16/50250-1, 17/25908-6, 17/20945-0, 14/12236-1, 16/06441-7, 18/15597-6, 13/50155-0, 17/02091-4, 15/24494-8)
GONCALVES DOS SANTOS, CLAUDIO FILIPI; MOREIRA, THIERRY PINHEIRO; COLOMBO, DANILO; PAPA, JOAO PAULO; NYSTROM, I; HEREDIA, YH; NUNEZ, VM. Does Pooling Really Matter? An Evaluation on Gait Recognition. PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS (CIARP 2019), v. 11896, p. 10-pg., . (16/06441-7, 17/25908-6, 14/12236-1, 13/07375-0)
KUNCHEVA, LUDMILA I.; YOUSEFI, PARIA; ALMEIDA, JURANDY; IEEE. Comparing Keyframe Summaries of Egocentric Videos: Closest-to-Centroid Baseline. PROCEEDINGS OF THE 2017 SEVENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA 2017), v. N/A, p. 6-pg., . (16/06441-7)
SUGI AFONSO, LUIS CLAUDIO; PASSOS, LEANDRO, JR.; PAPA, JOAO PAULO; IEEE. Enhancing Brain Storm Optimization Through Optimum-Path Forest. 2018 IEEE 12TH INTERNATIONAL SYMPOSIUM ON APPLIED COMPUTATIONAL INTELLIGENCE AND INFORMATICS (SACI), v. N/A, p. 6-pg., . (13/07375-0, 14/12236-1, 14/16250-9, 16/06441-7)
VALEM, LUCAS PASCOTTI; GUIMARAES PEDRONETTE, DANIEL CARLOS; ALMEIDA, JURANDY. Unsupervised similarity learning through Cartesian product of ranking references. PATTERN RECOGNITION LETTERS, v. 114, p. 12-pg., . (16/06441-7, 14/04220-8, 13/08645-0, 17/02091-4)
DUARTE, LEONARDO A.; PENATTI, OTAVIO A. B.; ALMEIDA, JURANDY; IEEE. Bag of Genres for Video Retrieval. 2016 29TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 8-pg., . (16/06441-7)
PASSOS, LEANDRO APARECIDO; RODRIGUES, DOUGLAS; PAPA, JOAO PAULO; IEEE. Quaternion-Based Backtracking Search Optimization Algorithm. 2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), v. N/A, p. 8-pg., . (14/16250-9, 13/07375-0, 14/12236-1, 16/06441-7)
BARRETO, THIAGO L. M.; ROSA, RAFAEL A. S.; WIMMER, CHRISTIAN; MOREIRA, JOAO R.; BINS, LEONARDO S.; MENOCCI CAPPABIANCO, FABIO AUGUSTO; ALMEIDA, JURANDY. Classification of Detected Changes From Multitemporal High-Res Xband SAR Images: Intensity and Texture Descriptors From SuperPixels. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, v. 9, n. 12, p. 13-pg., . (16/06441-7)
ALMEIDA, JURANDY; PEDRONETTE, DANIEL C. G.; ALBERTON, BRUNA C.; MORELLATO, LEONOR PATRICIA C.; TORRES, RICARDO DA S.. Unsupervised Distance Learning for Plant Species Identification. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, v. 9, n. 12, p. 14-pg., . (13/50169-1, 13/50155-0, 10/52113-5, 14/00215-0, 16/06441-7, 10/51307-0, 13/08645-0, 09/18438-7)
ALMEIDA, JURANDY; PEDRONETTE, DANIEL C. G.; ALBERTON, BRUNA C.; MORELLATO, LEONOR PATRICIA C.; TORRES, RICARDO DA S.. Unsupervised Distance Learning for Plant Species Identification. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, v. 9, n. 12, 1, SI, p. 5325-5338, . (13/50169-1, 09/18438-7, 10/52113-5, 16/06441-7, 10/51307-0, 13/08645-0, 14/00215-0, 13/50155-0)
BARRETO, THIAGO L. M.; ROSA, RAFAEL A. S.; WIMMER, CHRISTIAN; MOREIRA, JOAO R.; BINS, LEONARDO S.; MENOCCI CAPPABIANCO, FABIO AUGUSTO; ALMEIDA, JURANDY. Classification of Detected Changes From Multitemporal High-Res Xband SAR Images: Intensity and Texture Descriptors From SuperPixels. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, v. 9, n. 12, 1, SI, p. 5436-5448, . (16/06441-7)
BALDASSIN, ALEXANDRO; WENG, YING; GUIMARAES PEDRONETTE, DANIEL CARLOS; ALMEIDA, JURANDY. An optimized unsupervised manifold learning algorithm for manycore architectures. INFORMATION SCIENCES, v. 496, p. 410-430, . (16/06441-7, 13/08645-0)
KUNCHEVA, LUDMILA I.; YOUSEFI, PARIA; ALMEIDA, JURANDY. Edited nearest neighbour for selecting keyframe summaries of egocentric videos. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, v. 52, p. 118-130, . (16/06441-7)
DUARTE, LEONARDO A.; PENATTI, OTAVIO A. B.; ALMEIDA, JURANDY; IEEE. Bag of Attributes for Video Event Retrieval. PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), v. N/A, p. 8-pg., . (16/06441-7)
ALMEIDA, JURANDY; VALEM, LUCAS P.; PEDRONETTE, DANIEL C. G.; BATTIATO, S; GALLO, G; SCHETTINI, R; STANCO, F. A Rank Aggregation Framework for Video Interestingness Prediction. IMAGE ANALYSIS AND PROCESSING,(ICIAP 2017), PT I, v. 10484, p. 12-pg., . (16/06441-7, 13/08645-0, 17/02091-4)
VALEM, LUCAS PASCOTTI; DE OLIVEIRA, CARLOS RENAN; GUIMARAES PEDRONETTE, DANIEL CARLOS; ALMEIDA, JURANDY. Unsupervised Similarity Learning through Rank Correlation and kNN Sets. ACM Transactions on Multimedia Computing Communications and Applications, v. 14, n. 4, . (17/25908-6, 17/02091-4, 16/06441-7, 13/08645-0)
PASSOS, LEANDRO APARECIDO; SANTANA, MARCOS CLEISON; MOREIRA, THIERRY; PAPA, JOAO PAULO; IEEE. kappa-Entropy Based Restricted Boltzmann Machines. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), v. N/A, p. 8-pg., . (13/07375-0, 14/12236-1, 16/06441-7)
BARRETO, THIAGO L. M.; ROSA, RAFAEL A. S.; WIMMER, CHRISTIAN; MOREIRA, JOAO R.; BINS, LEONARDO S.; ALMEIDA, JURANDY; CAPPABIANCO, FABIO A. M.; IEEE. BMINSAR: A NOVEL APPROACH FOR INSAR PHASE DENOISING BY CLUSTERING AND BLOCK MATCHING. 2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), v. N/A, p. 4-pg., . (16/06441-7)