Tajadura-Jimenez, A;
Bianchi-Berthouze, N;
Furfaro, E;
Bevilacqua, F;
(2015)
Sonification of surface tapping changes behavior, surface perception, and emotion.
IEEE Multimedia
, 22
(1)
48 - 57.
10.1109/MMUL.2015.14.
Preview |
Text
Furfaro_etal_IEEE_Multimedia_revision_FINAL.pdf Download (708kB) | Preview |
Abstract
The audio feedback resulting from object interaction provides information about the material of the surface and about one's own motor behavior. With the current developments in interactive sonification, it's now possible to digitally change this audio feedback, making the use of interactive sonification a compelling approach to shape tactile surface interactions. Here, the authors present a prototype for a sonic interactive surface, capable of delivering surface tapping sounds in real time when triggered by users' taps on a real surface or on an imagined 'virtual' surface. In this system, the delivered audio feedback can be varied so that the tapping sounds correspond to different applied strengths during tapping. The authors also propose a multidimensional measurement approach to evaluate user experiences of multimodal interactive systems. They evaluated their system by looking at the effect of the altered tapping sounds on emotional action-related responses, the users' interactions with the surface, and perceived surface hardness. Results show the influence of the sonification of tapping at all levels: emotional, behavioral, and perceptual. These results have implications on the design of interactive sonification displays and tangible auditory interfaces aiming to change perceived and subsequent motor behavior as well as perceived material properties.
| Type: | Article |
|---|---|
| Title: | Sonification of surface tapping changes behavior, surface perception, and emotion |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/MMUL.2015.14 |
| Publisher version: | http://dx.doi.org/10.1109/MMUL.2015.14 |
| Language: | English |
| Additional information: | © 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
| Keywords: | emotional design, interaction styles, interactive sonification, multimedia, multimodal interactive system, multimodal interfaces, surface interaction, user experience, virtual surface |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/1464806 |
Archive Staff Only
 |
View Item |
