Frames und Diagramme im Dialog
Indexikalische und ikonische Zeichenmodi im verbal-gestischen Ko-Konstruieren von Reiserouten
DOI:
https://doi.org/10.14464/zsem.v43i1-2.737Keywords:
semantic frames, diagrams, cross modal, gestures, meaning constitution, indexicality, iconic signs, multimodal interaction, motion capture, mental spacesAbstract
This paper aims to show how semantic frames (Fillmore 1982) and diagrams (Peirce 1960) interact in the verbo-gestural co-construction of travelroutes in multimodal German dialogue data. Taking a cognitive-semiotic perspective (Mittelberg), we demonstrate how indexical and iconic signs jointly engender semiotic structure and meaning, in both an intramodal and intermodal (cross-modal) fashion. First, we focus on how linguistic and gestural means activitate frames through instantiating frame elements, distinguishing between material or body-based frame elements and those that are less grounded in direct experience and pertain to more abstract knowledge structures. We further present distinct semiotic profiles of three phases underpinning the dynamic process of dialogic travel planning: a predominantly indexical, an indexical-iconic, and a diagrammatic-iconic phase. Overall, indexicality again proves to be a fundamental principle of multimodal interaction. Indexicality conditions and orchestrates not only the interlocutors’ bodily anchorage in integrated physical and mental spaces (Fauconnier, Sweetser, Turner), but also their (inter-)subjective dialogue behavior and the multimodal fabric of emerging diagrams.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Irene Mittelberg, Linn-Marlen Rekittke
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright for articles published in this journal is retained by the authors. The content is published under a Creative Commons Licence Attribution 4.0 International (CC BY 4.0). This permits use, distribution, and reproduction in any medium, provided the original work is properly cited, and is otherwise in compliance with the licence.