OmniMR - Omnidirectional Mixed Reality with Spatially-Varying Environment Reflections from Moving 360° Video Cameras.
VR(2019)
摘要
We propose a new approach for creating omnidirectional mixed reality (OmniMR) from moving-camera 360° video. To insert virtual computer-generated elements into a moving-camera 360° video, we reconstruct camera motion and sparse scene content via structure from motion on stitched equirectangular video (the default output format of current 360° cameras). Then, to plausibly reproduce realworld lighting conditions for these inserted elements, we employ inverse tone mapping to recover high dynamic range environment maps which vary spatially along the camera path. We implement our approach into the Unity rendering engine for real-time object rendering with dynamic lighting and user interaction. This expands the use and flexibility of 360° video for mixed reality.
更多查看译文
关键词
Omnidirectional video, mixed reality, structure from motion, 3D reconstruction, lighting estimation, environment maps
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络