Re(de)fining Sonification: Project Classification Strategies in the Data Sonification Archive

PerMagnus LINDBORG*, Valentina CAIOLA, Paolo CIUCCARELLI, Manni CHEN, Sara LENZI

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

235 Downloads (CityUHK Scholars)

Abstract

This study focuses on a corpus of 445 sonification projects currently available in the Data Sonification Archive (DSA). The DSA develops in a collaborative process that involves researchers and creative communities, and has been online since early 2021. Projects are heuristically classified according to several aspects, in particular their intended purpose, targeted users, subject matter, sonification method, and combination of media. In the present study, we analyse six curatorial classification strategies, labelled Goal, Method, User, Macro Topic, Micro Topic, and MediaMix, and discuss their definitions and usefulness for the archive. We then introduce two computational classification strategies, respectively based on clustering of music information retrieval of sonification audio, and topic modelling of the descriptive texts that accompany DSA projects. Correlation analysis between curatorial and computational classifications, correspondingly sized, showed that the text-based method was more powerful than the audio-based methods. We then explored predictive modelling, tentatively achieving results for Goal, Method, and Macro Topic. This points towards the potential for automatic classification to assist in the curatorial management of the archive, as well as for similar repositories. The discussion focuses on how analysis of classification strategies supports a broadening of the definition of sonification, both as theoretical construct and as practice, where the communicative intention of the author, the aesthetic quality of the listening experience, a more explicit focus on narrative patterns, and other emerging aspects within sonification design, are all contributing factors to transitioning the field towards a mass medium for data representation, communication, and meaning-making.
Original languageEnglish
Pages (from-to)585-602
Number of pages18
JournalAES: Journal of the Audio Engineering Society
Volume72
Issue number9
DOIs
Publication statusPublished - Sept 2024

Funding

The research for this paper by PML was supported by Strategic Research Grant CityU #11602923 from City Uni- versity of Hong Kong, Hong Kong SAR, China. In addi- tion, VC received support from HKPFS, Hong Kong SAR; MC received support from UGC, City University of Hong Kong; SL received support from Center for Design, North- eastern University; Critical Alarms Lab, Delft University of Technology; Ikerbasque Foundation for Science, Bil- bao, Spain. The Data Sonification Archive infrastructure is hosted at - and maintained by - the Center for Design, Northeastern University.

Research Keywords

  • sonification
  • visualisation
  • perception
  • categorisation
  • classification
  • music information retrieval
  • natural language processing

Publisher's Copyright Statement

  • This open access article is published in the Journal of the Audio Engineering Society. LINDBORG, P., CAIOLA, V., CIUCCARELLI, P., CHEN, M., & LENZI, S. (2024). Re(de)fining Sonification: Project Classification Strategies in the Data Sonification Archive. AES: Journal of the Audio Engineering Society, 72(9), 585-602. https://doi.org/10.17743/jaes.2022.0167

Fingerprint

Dive into the research topics of 'Re(de)fining Sonification: Project Classification Strategies in the Data Sonification Archive'. Together they form a unique fingerprint.

Cite this