Immersive Orchestras: Audio Processing for Orchestral Music VR Content
2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES)(2016)
摘要
This paper combines Audio Signal Processing and Virtual Reality (VR) content to create novel immersive experiences for orchestral music audiences. In VR, the auralization of sound sources of recorded live content remains still a rather unexplored topic. We aim to build a multimodal experience, where visual and audio cues bring a sonic augmentation of the real scene. In the particular scenario of orchestral music content, our goal is to acoustically zoom on a particular instrument when the VR user stares at it. This work aims to improve the learning aspects of music listening, either for education or for personal enrichment. We use audio signal processing to separate different sound sources (instruments) in a acoustic scene (orchestral music recording). Given the signals captured by multiple microphones and the musical score of the piece, our system is able to isolate the different instruments. From the processed separated tracks, we use a binaural rendering technique to emphasize a give instrument. For these experiments we used original content from top European orchestras.
更多查看译文
关键词
immersive orchestras,orchestral music VR content,virtual reality,audio signal processing,orchestral music audiences,multimodal experience,visual cue,audio cue,sonic augmentation,music listening aspect,orchestral music recording,binaural rendering technique,European orchestras
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络