Depth image-based rendering for multiview generation

초록

Techniques for 3-D display have evolved from stereoscopic 3-D systems to multiview 3-D systems, which provide images corresponding to different viewpoints. Currently, new technology is required for application in multiview display systems that use input-source formats such as 2-D images to generate virtual-view images of multiple viewpoints. Due to the changes in viewpoints, occlusion regions of the original image become disoccluded, resulting in problems related to the restoration of output image information that is not contained in the input image. In this paper, a method for generating multiview images through a two-step process is proposed: (1) depth-map refinement and (2) disoccluded-area estimation and restoration. The first step, depth-map processing, removes depth-map noise, compensates for mismatches between RGB and depth, and preserves the boundaries and object shapes. The second step, disoccluded-area estimation and restoration, predicts the disoccluded area by using disparity and restores information about the area by using information about neighboring frames that are most similar to the occlusion area. Finally, multiview rendering generates virtual-view images by using a directional rendering algorithm with boundary blending.