Methods and operators for multimedia production via annotations

• Grant number: 13/03337-6
• Support Opportunities: Scholarships in Brazil - Post-Doctoral
• Start date: December 01, 2013
• End date: May 21, 2014
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Maria da Graca Campos Pimentel
• Grantee: Diogo Santana Martins
• Host Institution: Instituto de Ciências Matemáticas e de Computação (ICMC). Universidade de São Paulo (USP). São Carlos , SP, Brazil

Abstract

In the context of multimedia production processes, the task of documenting the various production activities and captured media elements (e.g. plot scripts, edit decision lists, intentional annotations and general metadata) prove to be of uttermost importance to secure the success and quality of the final product. Particularly in the case of amateur productions, the cost associated to the craft of these documentation resources may prove to be prohitive to end-users, provided the scarcity of human and material resources typically assessed in these productions. These requirements create opportunities for the development of methods to transparently annotate multimedia objects and to promote the use of such annotations to ease multimedia production. The research planned for the postdoctoral project will investigate solutions for this problem, taking as a conceptual foundation multimedia authoring processes centered around content-based multimedia annotations. The research plan is structured over the theoretical foundations and experimental tools developed by the candidate during his doctoral project, and entails the following primary contributions: \emph{i)} the application of automatic content-based multimodal annotations to the problem of authoring complex multimedia objects; and \emph{ii)} the development of multimedia composition operators in order to enable the semi-automatic authoring of multimedia information via content-based annotations.

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

MARTINS, DIOGO S.; CUNHA, BRUNA C. R.; YAGUINUMA, CRISTIANE A.; ZAINE, ISABELA; PIMENTEL, MARIA DA GRACA C.. Effects of Interactive Video Annotations on Students' Browsing Behavior and Perceived Workload. APPLIED COMPUTING REVIEW, v. 19, n. 2, p. 44-57, JUN 2019. (15/18117-7, 13/03337-6, 16/00351-6, 19/00508-0)

PIMENTEL, MARIA DA GRACA C.; YAGUINUMA, CRISTIANE A.; MARTINS, DIOGO S.; ZAINE, ISABELA; ASSOC COMP MACHINERY. Anchoring interactive points of interest on web-based instructional video: effects on students' interaction behavior and perceived experience. SAC '19: PROCEEDINGS OF THE 34TH ACM/SIGAPP SYMPOSIUM ON APPLIED COMPUTING, v. N/A, p. 8-pg., 2019-01-01. (13/03337-6, 15/18117-7, 16/00351-6)