UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour

Montano-Murillo, Roberto; Pittera, Dario; Frier, William; Georgiou, Orestis; Obrist, Marianna; Cornelio, Patricia; (2023) It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour. IEEE Transactions on Haptics pp. 1-12. 10.1109/toh.2023.3320492. (In press). Green open access

[thumbnail of It_Sounds_Cool_Exploring_Sonification_of_Mid-Air_Haptic_Textures_Exploration_on_Texture_Judgments_Body_Perception_and_Motor_Behaviour.pdf]
Preview
PDF
It_Sounds_Cool_Exploring_Sonification_of_Mid-Air_Haptic_Textures_Exploration_on_Texture_Judgments_Body_Perception_and_Motor_Behaviour.pdf - Published Version

Download (11MB) | Preview

Abstract

Ultrasonic mid-air haptic technology allows for the perceptual rendering of textured surfaces onto the user's hand. Unlike real textured surfaces, however, mid-air haptic feedback lacks implicit multisensory cues needed to reliably infer a texture's attributes (e.g., its roughness). In this paper, we combined mid-air haptic textures with congruent sound feedback to investigate how sonification could influence people's (1) explicit judgment of the texture attributes, (2) explicit sensations of their own hand, and (3) implicit motor behavior during haptic exploration. Our results showed that audio cues (presented solely or combined with haptics) influenced participants' judgment of the texture attributes (roughness, hardness, moisture and viscosity), produced some hand sensations (the feeling of having a hand smoother, softer, looser, more flexible, colder, wetter and more natural), and changed participants' speed (moving faster or slower) while exploring the texture. We then conducted a principal component analysis to better understand and visualize the found results and conclude with a short discussion on how audio-haptic associations can be used to create embodied experiences in emerging application scenarios in the metaverse.

Type: Article
Title: It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/toh.2023.3320492
Publisher version: https://doi.org/10.1109/TOH.2023.3320492
Language: English
Additional information: © The Authors 2023. Original content in this paper is licensed under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) Licence (https://creativecommons.org/licenses/by/4.0/).
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10179039
Downloads since deposit
1,008Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item