Key-point based stereo matching and its application to interpolations

Abstract

In this paper, we propose a novel interpolation method to expand the decimated stereoscopic 3D (S3D) video to the original size. The basic approach for our interpolation is to exploit key-point correspondences between the stereoscopic left and right images. Since the rectified left and right frames of the S3D videos are aligned, a simple key-point detection method can be employed without considering the scale and transformation invariances. After detecting matched key-point pairs between the left and right images, we can interpolate the decimated pixels by exploiting the corresponding key-points in the opposite view as well as their neighboring pixels in the current view. The merit of our method is that no side information overhead is required for the interpolation. Nevertheless, the proposed method yields similar or even better PSNR performance than the previous side information method.