Academic Commons

Articles

Multispeaker Speech Activity Detection for the ICSI Meeting Recorder

Pfau, Thilo; Ellis, Daniel P. W.; Stolcke, Andreas

As part of a project into speech recognition in meeting environments, we have collected a corpus of multichannel meeting recordings. We expected the identification of speaker activity to be straightforward given that the participants had individual microphones, but simple approaches yielded unacceptably erroneous labelings, mainly due to crosstalk between nearby speakers and wide variations in channel characteristics. Therefore, we have developed a more sophisticated approach for multichannel speech activity detection using a simple hidden Markov model (HMM). A baseline HMM speech activity detector has been extended to use mixtures of Gaussians to achieve robustness for different speakers under different conditions. Feature normalization and crosscorrelation processing are used to increase the channel independence and to detect crosstalk. The use of both energy normalization and crosscorrelation based postprocessing results in a 35% relative reduction of the frame error rate. Speech recognition experiments show that it is beneficial in this multispeaker setting to use the output of the speech activity detector for presegmenting the recognizer input, achieving word error rates within 10% of those achieved with manual turn labeling.

Files

Also Published In

Title
ASRU 2001: 2001 IEEE Workshop on Automatic Speech Recognition and Understanding: conference proceedings: 9-13 December, 2001, Madonna di Campiglio, Italy
DOI
https://doi.org/10.1109/ASRU.2001.1034599

More About This Work

Academic Units
Electrical Engineering
Publisher
IEEE
Published Here
July 2, 2012
Academic Commons provides global access to research and scholarship produced at Columbia University, Barnard College, Teachers College, Union Theological Seminary and Jewish Theological Seminary. Academic Commons is managed by the Columbia University Libraries.