Full text
| |
| Author(s): |
Aurea Rossy Soriano Vargas
Total Authors: 1
|
| Document type: | Master's Dissertation |
| Press: | São Carlos. |
| Institution: | Universidade de São Paulo (USP). Instituto de Ciências Matemáticas e de Computação (ICMC/SB) |
| Defense date: | 2013-05-09 |
| Examining board members: |
Maria Cristina Ferreira de Oliveira;
Haim Levkowitz;
Ricardo da Silva Torres
|
| Advisor: | Maria Cristina Ferreira de Oliveira |
| Abstract | |
The layouts generated by multidimensional projection techniques can be the basis for different visualization metaphors that are applicable to various data types. There is much interest in investigating alternatives to the point cloud metaphor commonly used to present projection layouts. In this work, we investigated this problem, targeting the domain of music visualization. There are many dimensions involved in the perception and manipulation of music and therefore it is difficult to find an intuitive computer model to represent music. Our goal in this work was to investigate visual representations capable of conveying the musical structure of a song, as well as displaying a collection of songs so as to highlight their similarities. The proposed solution consists of an iconic representation for individual songs, that is associated with the spatial positioning of groups or collections of songs generated by a multidimensional projection technique that reflects their structural similarity. Both the projection and the icon require a feature vector representation of the music. The features are extracted from MIDI files, as the nature of the MIDI descriptions allows the identification of the relevant musical structures. These features provide the input for both the dissimilarity comparison and for constructing the music icon. The spatial layout is computed with the Least Square Projection (LSP) technique, and similarities are computed using the Dynamic Time Warping (DTW) distance. The icon provides a visual summary of the chord repetitions in a particular song. We describe the process of generating these visual representations, describe a system that implements such funcionalities and illustrate how they can support some exploratory tasks on music collections, identifying possible usage scenarios (AU) | |
| FAPESP's process: | 11/14165-6 - Alternative visual metaphors for layouts from multidimensional projections |
| Grantee: | Aurea Rossy Soriano Vargas |
| Support Opportunities: | Scholarships in Brazil - Master |