The First Challenge on Generating Instructions in Virtual Environments

Alexander Koller, Kristina Striegnitz, Donna Byron, Justine Cassell, Robert Dale, Johanna Moore, and Jon Oberlander

In E. Krahmer and M. Theune (eds.), Empirical Methods in Natural Language Generation, volume 5790 of LNAI. Springer, 2010.

This paper describes the First Challenge on Generating Instructions in Virtual Environments (GIVE-1). GIVE is a shared task for generation systems which give real-time natural-language instructions to users in a virtual 3D world. These systems are evaluated by connecting users and NLG systems over the Internet. We describe the design and results of GIVE-1 as well as the participating NLG systems, and validate the experimental methodology by comparing the results collected over the Internet with results from a more traditional laboratory-based experiment.

Download: Download

BibTeX Entry
@InCollection{give-overview-09,
	author = {Alexander Koller and Kristina Striegnitz and Donna 
		Byron and Justine Cassell and Robert Dale and Johanna Moore and Jon Oberlander},
	title = {The First Challenge on Generating Instructions in Virtual Environments},
	booktitle = {Empirical Methods in Natural Language Generation},
	publisher = {Springer},
	year = 2010,
	editor = {E. Krahmer and M. Theune},
	series = {LNAI},
	volume = {5790}
}

Back: Publications