Prospective View on Sound Synthesis BCI Control in Light of Two Paradigms of Cognitive Neuroscience

Authors: Aramaki M., Kronland-Martinet R., Ystad S., Micoulaud-Franchi J-A., Vion-Dury J.
Publication Date: August 2014
Journal: Guide to Brain-Computer Music Interfacing (pp. 61-87, Springer Berlin Heidelberg, 2014)

Tags: Brain Imaging, Environmental Sounds, Sound Design

Abstract

Different trends and perspectives on sound synthesis control issues within a cognitive neuroscience framework are addressed in this article. Two approaches for sound synthesis based on the modelling of physical sources and on the modelling of perceptual effects involving the identification of invariant sound morphologies (linked to sound semiotics) are exposed. Depending on the chosen approach, we assume that the resulting synthesis models can fall under either one of the theoretical frameworks inspired by the representational-computational or enactive paradigms. In particular, a change of viewpoint on the epistemological position of the end-user from a third to a first person inherently involves different conceptualizations of the interaction between the listener and the sounding object. This differentiation also influences the design of the control strategy enabling an expert or an intuitive sound manipulation. Finally, as a perspective to this survey, explicit and implicit brain-computer interfaces (BCI) are described with respect to the previous theoretical frameworks, and a semiotic-based BCI aiming at increasing the intuitiveness of synthesis control processes is envisaged. These interfaces may open for new applications adapted to either handicapped or healthy subjects.

 

---