Advanced search
Start date
Betweenand


Granular visual music

Full text
Author(s):
Fernando Falci de Souza
Total Authors: 1
Document type: Doctoral Thesis
Press: Campinas, SP.
Institution: Universidade Estadual de Campinas (UNICAMP). Instituto de Artes
Defense date:
Examining board members:
Adolfo Maia Junior; Artemis Maria Francelin Sanchez Moroni; Stéphan Olivier Schaub; Milton Terumitsu Sogabe; Marcus Vinicius Fainer Bastos
Advisor: Adolfo Maia Junior
Abstract

This thesis deals with the development of a system to create multimodal art using the "Granularity Paradigm" that can be described as a way to create complex macrostructural objects by organizing a large amount of simple microstructures denoted grains. This thesis is divided is three parts. In Part I ¿ Starting Points, we present the fundamental concepts about the two main areas involved in this research: Granular Synthesis and Visual Music. Granular Synthesis is a sound synthesis technique originated in the physical model of sound introduced by Dennis Gabor in 1947. Visual Music specifies the aesthetic boundaries of a practice within multimodal art in which the visual elements of expression consists of color, form and movement, presented in a discourse with moments of tension and resolution, in this way reproducing the sensorial features usually associated with music. In Part II ¿ Audiovisual Granular Synthesis, we define a possible extension of Granular Synthesis to the domain of image, establishing a conceptual model and an associated computer model with which we can generate complex multimodal textures made dynamically with sound and visual grains and possible types of correspondences between them. In this direction, we developed two systems using JAVA programming language, Granular Streamer and Granular Drawer that implement respectively the granular synthesis of sound and image. We completed this set of systems integrating them to many strategies of control, some of them of our own development like, for example, the Granular Score, a graphical score to organize and arrange sound and visual grains in differed time, and with the Kinect, that provides a gestural control, as well as established systems like, for instance, Pure Data, Ableton Live and Adobe After Effects. In Part III ¿ Granular Visual Music, we focus the study object from the viewpoint of creative practice, that is, by creating and analyzing works of Visual Music built with sound and visual grains that we named Granular Visual Music, the keyword of this thesis. Therefore, we created fixed-media and performances works as a way to evaluate the theoretical framework and the computer systems we developed (AU)

FAPESP's process: 11/03713-2 - A study of real time generation and control of audio and visual landscapes with granular synthesis and gestural controllers.
Grantee:Fernando Falci de Souza
Support Opportunities: Scholarships in Brazil - Doctorate