Academic Commons

Presentations (Communicative Events)

Sentence alignment for monolingual comparable corpora

Elhadad, Noemie; Barzilay, Regina

We address the problem of sentence alignment for monolingual corpora, a phenomenon distinct from alignment in parallel corpora. Aligning large comparable corpora automatically would provide a valuable resource for learning of text-to-text rewriting rules. We incorporate context into the search for an optimal alignment in two complementary ways: learning rules for matching paragraphs using topic structure and further refining the matching through local alignment to find good sentence pairs. Evaluation shows that our alignment method outperforms state-of-the-art systems developed for the same task.


More About This Work

Academic Units
Computer Science
EMNLP '03 Proceedings of the 2003 conference on Empirical methods in natural language processing
Published Here
May 10, 2013
Academic Commons provides global access to research and scholarship produced at Columbia University, Barnard College, Teachers College, Union Theological Seminary and Jewish Theological Seminary. Academic Commons is managed by the Columbia University Libraries.