P-HRTF: Efficient personalized HRTF computation for high-fidelity spatial sound

Mixed and Augmented Reality(2014)

引用 43|浏览31
暂无评分
摘要
Accurate rendering of 3D spatial audio for interactive virtual auditory displays requires the use of personalized head-related transfer functions (HRTFs). We present a new approach to compute personalized HRTFs for any individual using a method that combines state-of-the-art image-based 3D modeling with an efficient numerical simulation pipeline. Our 3D modeling framework enables capture of the listener's head and torso using consumer-grade digital cameras to estimate a high-resolution non-parametric surface representation of the head, including the extended vicinity of the listener's ear. We leverage sparse structure from motion and dense surface reconstruction techniques to generate a 3D mesh. This mesh is used as input to a numeric sound propagation solver, which uses acoustic reciprocity and Kirchhoff surface integral representation to efficiently compute an individual's personalized HRTF. The overall computation takes tens of minutes on multi-core desktop machine. We have used our approach to compute the personalized HRTFs of few individuals, and we present our preliminary evaluation here. To the best of our knowledge, this is the first commodity technique that can be used to compute personalized HRTFs in a lab or home setting.
更多
查看译文
关键词
image motion analysis,image reconstruction,image representation,multiprocessing systems,numerical analysis,rendering (computer graphics),solid modelling,3D mesh generation,3D spatial audio rendering,Kirchhoff surface integral representation,P-HRTF,acoustic reciprocity,commodity technique,dense surface reconstruction technique,high-fidelity spatial sound,image-based 3D modeling,interactive virtual auditory displays,multicore desktop machine,nonparametric surface representation,numeric sound propagation solver,numerical simulation pipeline,personalized head-related transfer functions,sparse structure from motion technique
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要