Generating Instructions in Virtual Environments (GIVE): A Challenge and an Evaluation Testbed for NLG

Donna Byron, Alexander Koller, Jon Oberlander, Laura Stoia, and Kristina Striegnitz

In Proceedings of the Workshop on Shared Tasks and Comparative Evaluation in Natural Language Generation, Arlington, VA, 2007.

In this short position paper, we propose the task of generating instructions in a virtual environment as a challenge for the field of NLG. Key advantages of this scenario are that it is theory-neutral, scalable, and can be evaluated well.

Download: Download

BibTeX Entry
@InProceedings{give-07,
	author = {Donna Byron and Alexander Koller and Jon Oberlander and Laura Stoia and Kristina Striegnitz},
	title = {Generating Instructions in Virtual Environments ({GIVE}): {A} Challenge and an Evaluation Testbed for {NLG}},
	booktitle = {Proceedings of the Workshop on Shared Tasks and Comparative Evaluation in Natural Language Generation},
	year = 2007,
	editor = {Michael White and Robert Dale},
	address = {Arlington, VA}
}

Back: Publications