Home

Evaluating Speech Separation Systems

Daniel P. W. Ellis

Title:
Evaluating Speech Separation Systems
Author(s):
Ellis, Daniel P. W.
Date:
Type:
Book chapters
Department:
Electrical Engineering
Permanent URL:
Book/Journal Title:
Speech Separation by Humans and Machines
Book Author:
Divenyi, Pierre
Publisher:
Kluwer
Publisher Location:
New York
Abstract:
Common evaluation standards are critical to making progress in any field, but they can also distort research by shifting all the attention to a limited subset of the problem. Here, we consider the problem of evaluating algorithms for speech separation and acoustic scene analysis, noting some weaknesses of existing measures, and making some suggestions for future evaluations. We take the position that the most relevant 'ground truth' for sound mixture organization is the set of sources perceived by human listeners, and that best evaluation standards would measure the machine's match to this perception at a level abstracted away from the low-level signal features most often considered in signal processing.
Subject(s):
Communication
Physiological psychology
Publisher DOI:
10.1007/0-387-22794-6_20
Item views:
64
Metadata:
text | xml

In Partnership with the Center for Digital Research and Scholarship at Columbia University Libraries/Information Services | Terms of Use