Video retargeting based on group of frames

Abstract

Temporal coherence of retargeted video is important. Even a mild temporal inconsistency among subsequent frames can result in visually annoying artifacts, such as jittering or flickering. To reduce these artifacts, we assign a common seam for a group of consecutive frames (GoF). The video sequence is divided into GoFs, and a representative frame for each GoF is formed. Then, both the spatial saliency in each representative frame and the temporal coherence among the consecutive representative frames are considered to determine a common seam for each GoF. Since a fixed seam of the representative frame is applied to the whole frames in a GoF, there will be no jittering and flickering artifacts within the GoF. Also, since the temporal coherence between the two consecutive representative frames (i.e., two consecutive GoFs) was taken into account, the transition between two consecutive GoFs will be smooth. (c) 2013 SPIE and IS&T