Academic Commons

Presentations (Communicative Events)

Resources for the evaluation of summarization techniques

McKeown, Kathleen; Kan, Min-Yen; Klanvas, Judith L.; Lee, Susan

We report on two corpora to be used in the evaluation of component systems for the tasks of (1) linear segmentation of text and (2) summary-directed sentence extraction. We present characteristics of the corpora, methods used in the collection of user judgments, and an overview of the application of the corpora to evaluating the component system. Finally, we discuss the problems and issues with construction of the test set which apply broadly to the construction of evaluation resources for language technologies.

Files

More About This Work

Academic Units
Computer Science
Publisher
Proceedings of the 1st International Conference on Language Resources and Evaluation
Published Here
April 29, 2013
Academic Commons provides global access to research and scholarship produced at Columbia University, Barnard College, Teachers College, Union Theological Seminary and Jewish Theological Seminary. Academic Commons is managed by the Columbia University Libraries.