An Annotation Approach for Social and Referential Gaze in Dialogue

This paper introduces an approach for annotating eye gaze considering both its social and referential functions in multi-modal human-human dialogue. Detecting and interpreting the temporal patterns of gaze behaviour cues is natural for humans and also mostly an unconscious process. However, these cues are difficult for conversational agents such as robots or avatars to process or generate. The key factor is to recognise these variants and carry out a successful conversation, as misinterpretation can lead to total failure of the given interaction. This paper introduces an annotation scheme for eye-gaze in human-human dyadic interactions that is intended to facilitate the learning of eye-gaze patterns in multi-modal natural dialogue.
Research areas:
Type of Publication:
In Proceedings
Book title:
Proceedings of the Twelfth International Conference on Language Resources and Evaluation (LREC)
Hits: 22