A Visualization Framework for Feature Investigation in Soundscape Recordings

Author(s):Show less -

Reis, Clausius Duque G. ; Santos, Thalisson Nobre ; Oliveira, Maria Cristina F. ; Banissi, E ; Francese, R ; Bannatyne, MWM ; Wyeld, TG ; Sarfraz, M ; Pires, JM ; Ursyn, A ; Bouali, F ; Datia, N ; Venturini, G ; Polese, G ; Deufemia, V ; DiMascio, T ; Temperini, M ; Sciarrone, F ; Malandrino, D ; Zaccagnino, R ; Diaz, P ; Papadopoulo, F ; Anta, AF ; Cuzzocrea, A ; Risi, M ; Erra, U ; Rossano, V

• Document type: Journal article
• Source: 2018 22ND INTERNATIONAL CONFERENCE INFORMATION VISUALISATION (IV); v. N/A, p. 8-pg., 2018-01-01.

Abstract

Studies in soundscape ecology can generate large volumes of audio recordings collected over extensive time intervals. Extracting information from such data is challenging and time demanding. Important tasks, in this context, are to identify occurrences of acoustic events of interest and find out which combination of audio features are suitable for characterizing specific events or describing a particular soundscape. Researchers in soundscape ecology have been investigating approaches to accomplish such tasks effectively, and there is a demand for tools capable of assisting analysts in investigating large databases of ecological recordings. In this paper we describe a visualization framework for this purpose. The system includes multiple functionalities for soundscape analysis, comprising audio feature extraction, identification of relevant acoustic events by means of visualizations associated with audio playbacks, and event characterization by means of subspace feature analysis, also assisted by visualizations. The system implements a user-driven iterative pipeline that gives domain experts means to search for, identify and characterize acoustic events, gathering insight on which features better describe them and their originating soundscape. (AU)

• FAPESP's process: 17/05838-3 - Visual analytics: applications and a conceptual investigation
• Grantee: Maria Cristina Ferreira de Oliveira
• Support Opportunities: Regular Research Grants