About the project

The project builds on the experiences from the Artistic Research project Four sound perspectives in VR (2022-2024), where Mons Niklas Shack through ambisonic, binaural and Dolby Atmos productions investigated how immersive formats can create new forms of worldizing - transferring real acoustic qualities to virtual spaces and differences between the physical and perceptual perspectives of sound. This work established a methodological basis for understanding spatial sound as compositional material in immersive formats. In Perspectives in Hyperreal Spaces , this research is further developed through experiments with spatial immersive audio and XR formats such as Dolby Atmos, Auro-3D and Wave Field Synthesis. The focus is on methods where the spatiality of sound is adapted to the movement and position of the listener, so that the experience changes dynamically and site-specifically. The project draws on knowledge from institutions such as IRCAM (Paris) and ZKM | Zentrum für Kunst und Medien (Karlsruhe), which have been central to the development of spatial sound art.

A key aspect is the development of site-specific sound installations where the location acts as an extended speaker setup. This approach builds on the work Cars Choir - The Redemption Sound (2021-2025), where ten car bodies were transformed into speaker cabinets with vibration transducers and network-synchronized Raspberry Pi players in a 10-channel spatial system. Shack explores how such spatial setups can be combined with XR technology to create hybrid, interactive soundscapes - and thereby develop new formats where spatial audio functions as supporting artistic material, contributing to a new understanding of how spatial audio can function as supporting artistic material in future audiovisual formats.

In the project, Shack works in the field of tension between composition, sound technology and spatial perception and explores how 3D sound and interactive music can function as an independent artistic material in XR. The approach is both experimental and reflective, combining artistic practice with technological research. The focal point is a way of working where a composition is first created for a multi-speaker system (Dolby Atmos). This is then installed at a specific location where it is distributed with contact speakers. This version is recorded and further processed in XR as 3D sound and adaptive music. The location is scanned with LiDAR and photogrammetry, after which sound and visual elements are combined in Unreal Engine and Wwise. This develops and tests a method that transforms a composition into adaptive music, understood here as a dynamic and responsive structure that adapts to the user's movement, actions or mood in real time. The music co-creates the experience and changes depending on the context.

 

The project is funded through a grant from the Danish Ministry of Culture.

Who is behind it?