Composição musical colaborativa baseada em espacialização sonora em tempo real

Abstract

Sound localization is a skill that the human being possesses, which allows him to determine the direction of a certain sound source. To exploit this ability today, spatialized sound is widely used in art, film industry, gaming and virtual reality. In many of these scenarios, an engineer or sound designer is the central actor responsible for giving emotion to the projected images. He is the sound designer who orchestrates the distribution of each element of a sound scene by the sound boxes scattered in an environment, being his obligatory participation in the spatialization, so far. There are several applications that provide a spatial sound in real time, but in most cases, the process still depends on this character. In art, when it comes to an electroacoustic music concert, this character is also present, as responsible for controlling the sound. In games and in virtual reality, the sonorization of the elements and their behaviors follow a defined script. In order to supply the demand for tools that provide a sound spatialization, considering different sound sources to be controlled collaboratively by different actors, this work presents a scalable framework that provides real time spatialization, based on Project of Sonic interaction, applicable to multiple contexts. As opposed to other existing works aimed at real-time sound spatialization, this framework, developed in the Pure Data environment, provides a flexibility in the configuration of the speakers to be used, also allowing total and individual control of the location of various sound sources being processed in real time. By making use of custom code generation, this framework provides independence, scalability and performance for the applications, thus eliminating the centralizing figure of the sound designer. Being applicable in performances of electroacoustic music, or even in collaborative performances in which each user becomes an audience and composer at the same time. There is also the facilitation of the development of independent applications that exploit sound processing in real time, such as games, simulators and virtual reality. As a basis for solving the problem of spatial spatialization, Design Thinking (DT) was used, a solution-focused approach to complex problems in innovative and creative ways. The prototypes generated from the DT process gave rise to the developed framework; an analysis was made in at least three different contexts: Sound saturation point analysis, collaborative composition of spatialized electroacoustic music and sound spatialization of games.