Automating Image Morphing Using Structural Similarity on a Halfway Domain

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal

38 Scopus Citations
View graph of relations

Author(s)

  • Rodolfo S. LIMA
  • Diego NEHAB
  • Hugues HOPPE
  • Pedro V. SANDER
  • Jinhui YU

Detail(s)

Original languageEnglish
Article number168
Journal / PublicationACM Transactions on Graphics
Volume33
Issue number5
Publication statusPublished - Aug 2014
Externally publishedYes

Abstract

The main challenge in achieving good image morphs is to create a map that aligns corresponding image elements. Our aim is to help automate this often tedious task. We compute the map by optimizing the compatibility of corresponding warped image neighborhoods using an adaptation of structural similarity. The optimization is regularized by a thin-plate spline and may be guided by a few user-drawn points. We parameterize the map over a halfway domain and show that this representation offers many benefits. The map is able to treat the image pair symmetrically, model simple occlusions continuously, span partially overlapping images, and define extrapolated correspondences. Moreover, it enables direct evaluation of the morph in a pixel shader without mesh rasterization. We improve the morphs by optimizing quadratic motion paths and by seamlessly extending content beyond the image boundaries. We parallelize the algorithm on a GPU to achieve a responsive interface and demonstrate challenging morphs obtained with little effort.

Research Area(s)

  • Correspondences, GPU, Image interpolation, Motion paths, Parameterization, Poisson extension, Warping

Citation Format(s)

Automating Image Morphing Using Structural Similarity on a Halfway Domain. / LIAO, Jing; LIMA, Rodolfo S.; NEHAB, Diego; HOPPE, Hugues; SANDER, Pedro V.; YU, Jinhui.

In: ACM Transactions on Graphics, Vol. 33, No. 5, 168, 08.2014.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journal