Sorry, you need to enable JavaScript to visit this website.

UNSUPERVISED MUSICAL TIMBRE TRANSFER FOR NOTIFICATION SOUNDS

Citation Author(s):
Jing Yang, Tristan Cinquin, Gábor Sörös
Submitted by:
Jing Yang
Last updated:
16 June 2021 - 3:09am
Document Type:
Presentation Slides
Document Year:
2021
Event:
Presenters:
Jing Yang
Paper Code:
MLSP-35.6
 

We present a method to transform artificial notification sounds into various musical timbres. To tackle the issues of ambiguous timbre definition, the lack of paired notification-music sample sets, and the lack of sufficient training data of notifications, we adapt the problem for a cycle-consistent generative adversarial network and train it with unpaired samples from the source and the target domains. In addition, instead of training the network with notification sound samples, we train it with video game music samples that share similar timbral features. Through a number of experiments, we discuss the efficacy of the model in transferring the timbre of monophonic and even homophonic notifications while preserving their original melody envelopes. We envision notification timbre transfer as a way of less distracting information delivery, and we demonstrate example music pieces augmented with notifications after timbre transfer.

up
0 users have voted: