An experimental investigation of perspective alignment in gesture and speech

Authors

DOI:

https://doi.org/10.3765/elm.3.5757

Keywords:

perspective in gesture , free indirect discourse, interactions of perspective taking in gesture and speech

Abstract

Hinterwimmer et al. (2021) experimentally investigated the hypothesis that perspective in gesture and speech is by default aligned, i.e., when a character’s or protagonist’s perspective is conveyed in the speech signal, this utterance is preferably aligned with a character viewpoint gesture. If an utterance expresses an observer’s perspective, by contrast, it is more likely accompanied by an observer viewpoint gesture. Their results, however, showed an overall preference for character viewpoint gestures. They argued that there were pragmatic factors (e.g., informativity) at play blocking the hypothesized perspective alignment. The study reported here further investigates Hinterwimmer et al.’s (2021) hypothesis by comparing two different character viewpoint gestures paired with a verbal utterance in a rating study. The results suggest that, contrary to Hinterwimmer et al.’s (2021) hypothesis, multiple, potentially non-aligned perspectives can be simultaneously expressed in gesture and speech.

Downloads

Published

2025-01-24

Issue

Section

Articles