Academic Commons

Presentations (Communicative Events)

A WOz Variant with Contrastive Conditions

Levin, Esther; Passonneau, Rebecca

We present a variant of the WOz paradigm we refer to as incremental ablation. The new feature involves incrementally restricting the human wizard’s capacities in the direction of a dialog system. We lay out a data collection design with six conditions of user-system and user-wizard interactions that allows us to more precisely identify how to close the communication gap between humans and systems. We describe the application of the method to analysis of contexts in which ASR errors occur, giving us a means to investigate the problem solving strategies humans would resort to if their communication channel were restricted to be more like the machine’s. We describe how we can use the methodology to collect data that is more relevant to a particular learning paradigm involving Markov Decision Processes (MDP).

Files

More About This Work

Academic Units
Computer Science
Publisher
Proceedings of the Interspeech Sattelite Workshop, Dialogue on Dialogues: Multidisciplinary Evaluation of Advanced Speech-based Interactive Systems
Published Here
July 5, 2013
Academic Commons provides global access to research and scholarship produced at Columbia University, Barnard College, Teachers College, Union Theological Seminary and Jewish Theological Seminary. Academic Commons is managed by the Columbia University Libraries.