Cross-modal perception of noise-in-music : audiences generate spiky shapes in response to auditory roughness in a novel electroacoustic concert setting
Research output: Journal Publications and Reviews (RGC: 21, 22, 62) › 21_Publication in refereed journal › peer-review
Author(s)
Detail(s)
Original language | English |
---|---|
Article number | 178 |
Journal / Publication | Frontiers in Psychology |
Volume | 9 |
Online published | 20 Feb 2018 |
Publication status | Published - 2018 |
Externally published | Yes |
Link(s)
DOI | DOI |
---|---|
Attachment(s) | Documents
Publisher's Copyright Statement
|
Link to Scopus | https://www.scopus.com/record/display.uri?eid=2-s2.0-85042228620&origin=recordpage |
Permanent Link | https://scholars.cityu.edu.hk/en/publications/publication(d9c53e4f-aab1-458b-8e0b-d0583668c64b).html |
Abstract
Noise has become integral to electroacoustic music aesthetics. In this paper, we define noise as sound that is high in auditory roughness, and examine its effect on cross-modal mapping between sound and visual shape in participants. In order to preserve the ecological validity of contemporary music aesthetics, we developed Rama, a novel interface, for presenting experimentally controlled blocks of electronically generated sounds that varied systematically in roughness, and actively collected data from audience interaction. These sounds were then embedded as musical drones within the overall sound design of a multimedia performance with live musicians, Audience members listened to these sounds, and collectively voted to create the shape of a visual graphic, presented as part of the audio-visual performance. The results of the concert setting were replicated in a controlled laboratory environment to corroborate the findings. Results show a consistent effect of auditory roughness on shape design, with rougher sounds corresponding to spikier shapes. We discuss the implications, as well as evaluate the audience interface.
Research Area(s)
- Auditory roughness, Computer music, Cross-modal perception, Human-computer interaction, Multimedia, Noise
Citation Format(s)
Cross-modal perception of noise-in-music : audiences generate spiky shapes in response to auditory roughness in a novel electroacoustic concert setting. / Liew, Kongmeng; Lindborg, Per Magnus; Rodrigues, Ruth et al.
In: Frontiers in Psychology, Vol. 9, 178, 2018.Research output: Journal Publications and Reviews (RGC: 21, 22, 62) › 21_Publication in refereed journal › peer-review
Download Statistics
No data available