An Eye Tracking Analysis of Conversational Violations in Dyadic and Collaborative Interaction


Cagiltay B., ACARTÜRK C.

16th International Conference on Augmented Cognition (AC) Held as Part of the 24th International Conference on Human-Computer Interaction (HCII), ELECTR NETWORK, 26 June - 01 July 2022, vol.13310, pp.34-47 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 13310
  • Doi Number: 10.1007/978-3-031-05457-0_3
  • Country: ELECTR NETWORK
  • Page Numbers: pp.34-47
  • Keywords: Eye tracking, Conversational violations, Cooperative principle, GRICEAN, INFORMATION, LISTENERS, DECEPTION, SPEAKERS, ROBOT, MAXIM
  • Middle East Technical University Affiliated: Yes

Abstract

Linguistic principles are crucial in maintaining reliable and transparent communication for dyadic interactions. However, violating these principles might result in unwieldy and problematic communications. We use gaze as a medium to explore how visual attention and task performance changes when conversational violations occur. We conducted an eye-tracking study (N = 17) measuring changes in visual patterns in response to social communication errors, specifically Grice's Maxims violations. Our study investigates how social-communicative errors influence task performance and gaze during dyadic and collaborative social interactions. The results suggest participants' visual exploration patterns shift towards the violator when the maxim of Relation is violated in a task instruction. Gaze stays mainly within the task area after receiving instructions with Quantity, Quality, and Manner violations. Moreover, it takes longer to respond to task instructions that include Quantity and Quality violations, than the Manner and Relation violations. Finally, our qualitative analysis revealed participants' adaptive and non-adaptive strategies in response to the Quality violation. Our findings contribute to the design space of human performance in dyadic and collaborative interactions, with future work implications exploring human performance in joint system-human interactions.