Home

Combining Localization Cues and Source Model Constraints for Binaural Source Separation

Ron J. Weiss; Michael I. Mandel; Daniel P. W. Ellis

Title:
Combining Localization Cues and Source Model Constraints for Binaural Source Separation
Author(s):
Weiss, Ron J.
Mandel, Michael I.
Ellis, Daniel P. W.
Date:
Type:
Articles
Department:
Electrical Engineering
Volume:
53
Permanent URL:
Book/Journal Title:
Speech Communication
Abstract:
We describe a system for separating multiple sources from a two-channel recording based on interaural cues and prior knowledge of the statistics of the underlying source signals. The proposed algorithm effectively combines information derived from low level perceptual cues, similar to those used by the human auditory system, with higher level information related to speaker identity. We combine a probabilistic model of the observed interaural level and phase differences with a prior model of the source statistics and derive an EM algorithm for finding the maximum likelihood parameters of the joint model. The system is able to separate more sound sources than there are observed channels in the presence of reverberation. In simulated mixtures of speech from two and three speakers the proposed algorithm gives a signal-to-noise ratio improvement of 1.7 dB over a baseline algorithm which uses only interaural cues. Further improvement is obtained by incorporating eigenvoice speaker adaptation to enable the source model to better match the sources present in the signal. This improves performance over the baseline by 2.7 dB when the speakers used for training and testing are matched. However, the improvement is minimal when the test data is very different from that used in training.
Subject(s):
Electrical engineering
Acoustics
Publisher DOI:
http://dx.doi.org/10.1016/j.specom.2011.01.003
Item views:
141
Metadata:
text | xml

In Partnership with the Center for Digital Research and Scholarship at Columbia University Libraries/Information Services | Terms of Use