Experimental findings for a cross-modal account of dynamic binding in gesture-speech interaction

Authors

  • Kurt Erbach
  • Magnus Poppe
  • Cornelia Ebert

DOI:

https://doi.org/10.3765/elm.3.5830

Keywords:

multimodal, gesture, anaphora, pronouns, presupposition

Abstract

We report results of experiments on pronoun and presupposition binding across modalities. We show that ordinary pronouns (in the spoken/written domain) can be dynamically bound to gesturally introduced discourse referents and that presuppositions induced by spoken/written triggers (via e.g. ‘again’ or ‘too’) can be bound likewise. These experiments support research that has proposed the existence of cross-modal binding to motivate a formal framework that can account for interaction of various input of linguistic content from different dimensions and modalities.

Downloads

Published

2025-01-24

Issue

Section

Articles