Gestural interfaces based on complex rhythmic parameters: Interactive and creative environments involving performer and listener

• Grant number: 14/09070-4
• Support Opportunities: Scholarships in Brazil - Post-Doctoral
• Start date: November 01, 2014
• End date: June 30, 2017
• Field of knowledge: Linguistics, Literature and Arts - Arts - Music
• Agreement: Coordination of Improvement of Higher Education Personnel (CAPES)
• Principal Investigator: Jônatas Manzolli
• Grantee: Ana Luisa Fridman
• Host Institution: Núcleo Interdisciplinar de Comunicação Sonora (NICS). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil

Abstract

The present project is an outgrowth of a previous doctoral research conducted by the candidate and finalized in March 2013. In this previous research, the candidate addresses expressive materials and procedures found in non-Western music, proposing and experimenting hybrid environments for the practice of musical improvisation. In this previous research, movement and spatiality are valued for embedding complex rhythmic parameters, such as the asymmetry and polyrhythm, which are adapted to music improvisation proposals. In the unfolding research proposed here, the candidate searches gestural interfaces that integrate motion technology to generate sound environments supported by the Interdisciplinary Center for Sound Studies (NICS) based at UNICAMP and directed by prof. Dr. Jônatas Manzolli. The overall objective of the research is to create sound environments where the performer - a group of dancers and musicians - and the listener could both experience the environment exploring sound patterns through movement, interfering in real time on the sound result of the environment. The sound patterns triggered in these environments will be created from the manipulation of complex rhythmic parameters, supported by the idea of sound perception linked to the concept of embodied mind (Varela at all, 2001) and affordances (Gibson, 1979). To achieve these goals a study group made up of dancers and musicians will be created to be part of situations involving performances that occur during the research period, which will foster the emergence of poetic proposals and from interaction with researchers from the NICS, the development of technological support for instantiating and study new creative processes from that media support. This research also will be part of the Interactive Media Laboratory for Digital Immersion and Augmented Cognition (ImCognita) provided in the eScience project submitted to FAPESP.