Improving MIDI-audio alignment with acoustic features

Devaney, Johanna; Mandel, Michael I.; Ellis, Daniel P. W.

This paper describes a technique to improve the accuracy of dynamic time warping-based MIDI-audio alignment. The technique implements a hidden Markov model that uses aperiodicity and power estimates from the signal as observations and the results of a dynamic time warping alignment as a prior. In addition to improving the overall alignment, this technique also identifies the transient and steady state sections of the note. This information is important for describing various aspects of a musical performance, including both pitch and rhythm.


Also Published In

2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, October 18-21, 2009, Mohonk Mountain House, New Paltz, NY, USA

More About This Work

Academic Units
Electrical Engineering
Published Here
June 26, 2012