ParaPara: Synthesizing Pseudo-2.5D Content from Monocular Videos for Mixed Reality.
CHI Extended Abstracts(2018)
摘要
In this work, we propose a simple yet effective method for synthesizing a pseudo-2.5D scene from a monocular video for mixed reality (MR) content. We also propose the ParaPara system, which applies this method. Most previously proposed systems convert real-world objects into 3D graphic models using expensive equipment; this is a barrier for individuals or small groups to create MR content. ParaPara uses four points in an image and their manually estimated distances to synthesize MR content by applying deep neural networks and simple image processing techniques to monocular videos. The synthesized content can be observed through an MR head-mounted display, and spatial mapping and spatial sound are applied to support the interaction between the real-world and MR content. The proposed system is expected to reduce the entry barriers to create MR content because it can create such content from a large number of previously captured videos.
更多查看译文
关键词
Mixed Reality, Virtualized Reality, Image-based Modeling/Rendering, Real-world Events
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络