Semi-automated video morphing
Research output: Journal Publications and Reviews (RGC: 21, 22, 62) › 21_Publication in refereed journal › peer-review
|Journal / Publication||Computer Graphics Forum|
|Online published||15 Jul 2014|
|Publication status||Published - Jul 2014|
|Link to Scopus||https://www.scopus.com/record/display.uri?eid=2-s2.0-84904425070&origin=recordpage|
We explore creating smooth transitions between videos of different scenes. As in traditional image morphing, good spatial correspondence is crucial to prevent ghosting, especially at silhouettes. Video morphing presents added challenges. Because motions are often unsynchronized, temporal alignment is also necessary. Applying morphing to individual frames leads to discontinuities, so temporal coherence must be considered. Our approach is to optimize a full spatiotemporal mapping between the two videos. We reduce tedious interactions by letting the optimization derive the fine-scale map given only sparse user-specified constraints. For robustness, the optimization objective examines structural similarity of the video content. We demonstrate the approach on a variety of videos, obtaining results using few explicit correspondences.
- Categories and Subject Descriptors (according to ACM CCS), I.3.0 [Computer Graphics]: General - Video Processing