2007 Presentations (Communicative Events)
Generating Instructions in Virtual Environments (GIVE):
A Challenge and an Evaluation Testbed for NLG
Would it be helpful or detrimental for the field of NLG to have a generally accepted competition? Competitions have definitely advanced the state of the art in some fields of NLP, but the benefits sometimes come at the price of over-competitiveness, and there is a danger of overfitting systems to the concrete evaluation metrics. Moreover, it has been argued that there are intrinsic difficulties in NLG that make it harder to evaluate than other NLP tasks (Scott and Moore, 2006).
Subjects
Files
- byron_al_07.pdf application/pdf 224 KB Download File
More About This Work
- Academic Units
- Computer Science
- Published Here
- May 1, 2013