Iconicity in spatial language guides visual attention: A comparison between signers' and speakers' eye gaze during message preparation


Manhardt F., Özyürek A., Sümer B., Mulder K., KARADÖLLER ASTARLIOĞLU D. Z., Brouwer S.

Journal of Experimental Psychology: Learning Memory and Cognition, cilt.46, sa.9, ss.1735-1753, 2020 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 46 Sayı: 9
  • Basım Tarihi: 2020
  • Doi Numarası: 10.1037/xlm0000843
  • Dergi Adı: Journal of Experimental Psychology: Learning Memory and Cognition
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Social Sciences Citation Index (SSCI), Scopus, Academic Search Premier, IBZ Online, PASCAL, BIOSIS, Business Source Elite, Business Source Premier, Communication & Mass Media Index, EBSCO Education Source, Education Abstracts, Educational research abstracts (ERA), EMBASE, ERIC (Education Resources Information Center), MEDLINE, MLA - Modern Language Association Database, Psycinfo
  • Sayfa Sayıları: ss.1735-1753
  • Anahtar Kelimeler: Eye-tracking, Iconicity, Language production, Sign language, Visual attention
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

To talk about space, spoken languages rely on arbitrary and categorical forms (e.g., left, right). In sign languages, however, the visual-spatial modality allows for iconic encodings (motivated form-meaning mappings) of space in which form and location of the hands bear resemblance to the objects and spatial relations depicted. We assessed whether the iconic encodings in sign languages guide visual attention to spatial relations differently than spatial encodings in spoken languages during message preparation at the sentence level. Using a visual world production eye-tracking paradigm, we compared 20 deaf native signers of Sign-Language-of-the-Netherlands and 20 Dutch speakers' visual attention to describe left versus right configurations of objects (e.g., "pen is to the left/right of cup"). Participants viewed 4-picture displays in which each picture contained the same 2 objects but in different spatial relations (lateral [left/right], sagittal [front/behind], topological [in/on]) to each other. They described the target picture (left/right) highlighted by an arrow. During message preparation, signers, but not speakers, experienced increasing eye-gaze competition from other spatial configurations. This effect was absent during picture viewing prior to message preparation of relational encoding. Moreover, signers' visual attention to lateral and/or sagittal relations was predicted by the type of iconicity (i.e., object and space resemblance vs. space resemblance only) in their spatial descriptions. Findings are discussed in relation to how "thinking for speaking" differs from "thinking for signing" and how iconicity can mediate the link between language and human experience and guides signers' but not speakers' attention to visual aspects of the world.