Enhancing referential success by tracking hearer gaze

Alexander Koller, Konstantina Garoufi, Maria Staudte, and Matthew Crocker

In Proceedings of the 13th Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL), Seoul, 2012.

The ability to monitor the communicative success of its utterances and, if necessary, provide feedback and repair is useful for a dialog system. We show that in situated communication, eyetracking can be used to reliably and efficiently monitor the hearer's reference resolution process. An interactive system that draws on hearer gaze to provide positive or negative feedback after referring to objects outperforms baseline systems on metrics of referential success and user confusion.

Note: Won the best paper award.

Download: Download

BibTeX Entry
@InProceedings{give-et-12b,
	author = {Alexander Koller and Konstantina Garoufi and Maria
		Staudte and Matthew Crocker},
	title = {Enhancing referential success by tracking hearer gaze},
	booktitle = {Proceedings of the 13th Annual SIGdial Meeting on
		Discourse and Dialogue (SIGDIAL)},
	year = 2012,
	address = {Seoul}
}

Back: Publications