Gao, Jiajun; Gu, Yan; (2024) Same Same But Different: The Influence of Ambiguity Awareness on Speech and Gesture Production. In: Samuelson, KL and Frank, SL and Toneva, M and Mackey, A and Hazeltine, E, (eds.) Proceedings of the Annual Meeting of the Cognitive Science Society, Volume 46. (pp. pp. 6006-6013). University of California: Rotterdam, Netherlands.

Preview

Text Gao&Gu2024_AmbiguityAwareness_GestureProsody.pdf - Published Version Download (582kB) | Preview

Abstract

We explored (1) the differences in prosody and gesture when speakers were aware and unaware of ambiguities, and (2) the insight of multimodal ambiguity resolution on communication efficiency. Thirty-two Mandarin speakers articulated twenty-two ambiguous Mandarin sentences. Half could be disambiguated using prosody (half couldn't). First, participants articulated each sentence and explained its meaning to a confederate, revealing their dominant interpretation and ambiguity awareness. Second, participants articulated the same ambiguous sentences twice according to hints indicating two meanings. Results showed participants hardly realised ambiguities. Speakers produced mostly more prominent prosody and more gestures when recognising ambiguities. When ambiguity was aware, prosodically unambiguous sentences were produced with various prosodic cues, with referential and non-referential gestures. However, prosodically ambiguous sentences were produced with more referential but hardly any non-referential gestures. In conclusion, speakers adopt multimodal strategies to achieve communication efficiency with a trade-off between modalities, depending on their ambiguity awareness.

Download activity - last month

Export as JSONCSVXML

Download activity - last 12 months

Export as XMLCSVJSON

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item