Ellis Daniel P. W. author Columbia University. Electrical Engineering Columbia University. Electrical Engineering originator text Book chapters 2004 manuscript version English Common evaluation standards are critical to making progress in any field, but they can also distort research by shifting all the attention to a limited subset of the problem. Here, we consider the problem of evaluating algorithms for speech separation and acoustic scene analysis, noting some weaknesses of existing measures, and making some suggestions for future evaluations. We take the position that the most relevant 'ground truth' for sound mixture organization is the set of sources perceived by human listeners, and that best evaluation standards would measure the machine's match to this perception at a level abstracted away from the low-level signal features most often considered in signal processing. Communication Physiological psychology Divenyi Pierre editor New York Kluwer 2005 295 304 10.1007/0-387-22794-6_20 http://hdl.handle.net/10022/AC:P:12564 NNC NNC 2012-02-15 14:22:02 -0500 2012-02-15 14:36:39 -0500 6568 eng