Sorry, you need to enable JavaScript to visit this website.

InstListener: An Expressive Parameter Estimation System Imitating Human Performances of Monophonic Musical Instruments

Citation Author(s):
Zhengshan Shi, Tomoyasu Nakano, Masataka Goto
Submitted by:
Zhengshan Shi
Last updated:
12 April 2018 - 6:39pm
Document Type:
Poster
Event:
Presenters:
Zhengshan Shi
Paper Code:
1852
 

We present InstListener, a system that takes an expressive mono- phonic solo instrument performance by a human performer as the input and imitates its audio recordings by using an existing MIDI (Musical Instrument Digital Interface) synthesizer. It automatically analyzes the input and estimates, for each musical note, expressive performance parameters such as the timing, duration, discrete semitone-level pitch, amplitude, continuous pitch contour, and continuous amplitude contour. The system uses an iterative process to estimate and update those parameters by analyzing both the input and output of the system so that the output from the MIDI synthesizer can be similar enough to the input. Our evaluation results showed that the iterative parameter estimation improved the accuracy of imitating of the input performance and thus increased the naturalness and expressiveness of the output performance.

up
0 users have voted: