Novel Multi-View Generation Framework For 3d Displays

In this paper, we propose a novel multi-view generation framework that considers the spatiotemporal consistency of each synthesized multi-view. Rather than independently filling in the holes of individual generated images, the proposed framework gathers hole information from each synthesized multi-view image to a reference viewpoint. The method then constructs a hole map and a SVRL (single view reference layer) at the reference viewpoint before restoring the holes in the SVRL, thereby generating a spatiotemporally consistent view. A hole map is constructed using depth information of the reference viewpoint and the input/output baseline length ratio. Thus, the holes in the SVRL can also represent holes in other multi-view images. To achieve temporally consistent hole filling in the SVRL, the restoration of holes in the current SVRL is performed by propagating the pixel value of the previous SVRL. Further hole filling is performed using a depth-and exemplar-based inpainting method. The experimental results showed that the proposed method generates high-quality spatiotemporally consistent multi-view images in various input/output environments. In addition, the proposed framework decreases the complexity of the hole-filling process by reducing repeated hole filling.