audio tracking for Live VR – Orange Lab
Vectors of innovation where new technologies are developed, Orange Labs work to improve telecommunications services and digital experiences. It is on the Orange Atalante site in Rennes that a project aimed at improving the live virtual reality (VR) experience was undertaken.
The objective is to be able to follow the artists in movement for spatialized audio mixing in real time and to illuminate them thanks to automated tracking. This project is particularly relevant for live music, sports and theater applications in VR, as well as television and podcasts in Dolby Atmos, Binaural or Ambisonic formats.
Technologies used
- K SYSTEM tracking system from Naostage: K SYSTEM allows artists to be followed without requiring tags on the performers or in their pockets. Monitoring is done only by cameras.
- LSpat Revolution software from FLUX::: Used for real-time spatialization of singers.
- Equipment from Kariba Productions and Virtual Audio: The performance was filmed in 12K VR and recorded with high definition audio quality.
Le projet a impliqué les artistes June Caravel et Gwendolyne Coronado, dont les positions étaient envoyées au logiciel Spat Revolution pour la spatialisation en temps réel et à l’éclairage pour un suivi automatisé. Voici les principales étapes :
- Studio Capture:
Use of K SYSTEM in the studio at a height of 3m50 and at a minimum distance of 3m from the sources. Data transmission via OSC to Spat Revolution. Capture with VR 360 cameras for ambisonic mixing.
- Production and Recording:
The performance “My star” was filmed in 12K VR by Éric VIDAL of Kariba Productions. Audio recording produced by Eric Munch of Virtuel Audio.
Results
The result was clear: effective monitoring and more than smooth integration. Indeed, as expected, the tracking of the artists allowed real-time audio spatialization without tags and without any hassles from installation to the final result. Additionally, Naostage's OSC worked perfectly with Spat Revolution, ensuring optimal coordination between sound and light.
& remerciements
The project carried out at the Orange Lab in Rennes demonstrates the efficiency and innovation in the use of wireless tracking for live performances in VR. Thanks to collaboration with several technologies and experts, the team was able to offer an immersive and real-time experience, opening up new possibilities for live shows and VR captures.
Merci à Marc Emerit, Christophe Daguet et Arnaud Lefort de l’Orange Lab, Éric VIDAL de Kariba Productions, Alexis Reymond et Nathan Van de Hel de Naostage, Nicolas Erard de FLUX::, ainsi qu’aux artistes June Caravel, Gwendolyne Coronado et Vincent Thevenot pour leur participation et leur engagement dans ce projet.
