Full text
| |
| Author(s): |
Gabriel Rimoldi
Total Authors: 1
|
| Document type: | Doctoral Thesis |
| Press: | Campinas, SP. |
| Institution: | Universidade Estadual de Campinas (UNICAMP). Instituto de Artes |
| Defense date: | 2018-02-27 |
| Examining board members: |
Jônatas Manzolli;
Stéphan Olivier Schaub;
José Henrique Padovani Velloso;
Daniel Luis Barreiro;
Felipe de Oliveira Amorim
|
| Advisor: | Jônatas Manzolli |
| Abstract | |
This research comprises a theoretical, computational and creative study on interactive systems with support of Musical Digital Interfaces (DMIs). We propose the construction of an augmented instrument ¿ the MetaFlute ¿ that exploits direct gestural capture trough coupled sensors and music information retrieval via audio signal processing applied to multimodal creative contexts. The interactive design was based on an ecological model of interface mapping, in which the relationships between input data and sound generation parameters could dynamically modify in relation to sonic and motion detected patterns. We used clustering and unsupervised machine learning techniques for pattern recognition to modifying the mapping functions which associate the input data to the control parameters of the sound generation systems. We conceived two audiovisual works exploring different proposals of musical improvisation with the MetaFlute, thus creating a presupposition for the interface to suit the performance situations presented by the performer. Our intention is that the application of such architecture provided a certain plasticity to the interface, capable of changing in relation to the environmental contingencies encountered. Finally, we present an analysis of the performances performed with MetaFlauta, emphasizing the characterization of recurrence patterns (AU) | |
| FAPESP's process: | 14/13166-7 - Eco-improvisation: an approach to technological mediation in context of musical digital interfaces |
| Grantee: | Gabriel Rimoldi de Lima |
| Support Opportunities: | Scholarships in Brazil - Doctorate |