Multimodal Communication in Instructional Settings: An Investigation of the Functional Roles of Gestures and Arrows

Autores/as

  • Cengiz Acarturk Middle East Technical University & Jagiellonian University, Poland http://orcid.org/0000-0002-5443-6868
  • Melda Coskun Middle East Technical University, Turkey & McMaster University
  • Serap Emil Middle East Technical University

Palabras clave:

Modality, deixis, arrows, multimodality

Resumen

In daily communication and instructional settings, arrows and spontaneous gestures usually convey similar spatial information to interlocutors. They can visualize spatial information in 2D or 3D space based on shared conceptual and spatial representations. The present study investigates the relationship between spontaneous gestures and arrows from the perspective of generation and comprehension. We introduce a corpus of arrows in written multimodal text and a corpus of gestures generated during communication through multimodal instructional material. We also report an experimental investigation that used corpus material to study the impact of gestures on comprehension learning. A comparison of the corpora reveals functional similarities and differences between arrows and gestures and their complementary role in multimodal communication. The findings suggest that arrows and gestures may share a common conceptual space during communication, having a significant impact on comprehension and learning.

Biografía del autor/a

Cengiz Acarturk, Middle East Technical University & Jagiellonian University, Poland

Associate Professor in Cognitive Science

Melda Coskun, Middle East Technical University, Turkey & McMaster University

PhD Student at the Cognitive Science of Language Department

Serap Emil, Middle East Technical University

Associate Professor at the Educational Administration and Planning Department

Publicado

2022-01-05

Cómo citar

Acarturk, C., Coskun, M., & Emil, S. (2022). Multimodal Communication in Instructional Settings: An Investigation of the Functional Roles of Gestures and Arrows. Revista Signos. Estudios De Lingüística, 54(107). Recuperado a partir de http://www.revistasignos.cl/index.php/signos/article/view/816

Número

Sección

Multimodalidad y Multimedios