Seeing Circles and Drawing Ellipses: When Sound Biases Reproduction of Visual Motion
Authors: Thoret E., Aramaki M., Bringoux L., Ystad S., Kronland-Martinet R.
Publication Date: April 2016
Journal: Plos One (11(4): e0154475, 2016)
Tags: Solid Sounds, Sound and Motion
The perception and production of biological movements is characterized by the 1/3 power law, a relation linking the curvature and the velocity of an intended action. In particular, motions are perceived and reproduced distorted when their kinematics deviate from this biological law. Whereas most studies dealing with this perceptual-motor relation focused on visual or kinaesthetic modalities in a unimodal context, in this paper we show that auditory dynamics strikingly biases visuomotor processes. Biologically consistent or inconsistent circular visual motions were used in combination with circular or elliptical auditory motions. Auditory motions were synthesized friction sounds mimicking those produced by the friction of the pen on a paper when someone is drawing. Sounds were presented diotically and the auditory motion velocity was evoked through the friction sound timbre variations without any spatial cues. Remarkably, when subjects were asked to reproduce circular visual motion while listening to sounds that evoked elliptical kinematics without seeing their hand, they drew elliptical shapes. Moreover, distortion induced by inconsistent elliptical kinematics in both visual and auditory modalities added up linearly. These results bring to light the substantial role of auditory dynamics in the visuo-motor coupling in a multisensory context.
Videos accompagnying the article
Note that the visual sample rate of the original visual stimulus has been downsampled to 30 Hz and the audio encoded in the AAC format due to technical capabilities.
Video 1: Audiovisual stimulus (ΦV = 90°; ΦA = 90°) and the corresponding averaged reproduced movement.
Video 2: Audiovisual stimulus (ΦV = 90°; ΦA = 45°) and the corresponding averaged reproduced movement.
Video 3: Audiovisual stimulus (ΦV = 45°; ΦA = 90°) and the corresponding averaged reproduced movement.
Video 4: Audiovisual stimulus (ΦV = 45°; ΦA = 45°) and the corresponding averaged reproduced movement.