ATFaceGAN : Single Face Semantic Aware Image Restoration and Recognition from Atmospheric Turbulence
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 240-251 |
Number of pages | 12 |
Journal / Publication | IEEE Transactions on Biometrics, Behavior, and Identity Science |
Volume | 3 |
Issue number | 2 |
Online published | 9 Feb 2021 |
Publication status | Published - Apr 2021 |
Externally published | Yes |
Link(s)
Abstract
Degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame restoration algorithm which disentangles the blur and deformation due to turbulence and reconstructs a restored image. The disentanglement is achieved by decomposing the distortion due to turbulence into blur and deformation components using a deblur generator and a deformation correction generator, respectively. Two paths of restoration are implemented to regularize the disentanglement and generate two restored images from a given degraded image. A fusion function combines the features of the restored images to reconstruct a sharp image with rich details. Adversarial and perceptual losses are added to reconstruct a sharp image and suppress the artifacts respectively. Extensive experiments demonstrate the effectiveness of the proposed restoration algorithm, which achieves satisfactory performance for face restoration and face recognition tasks. © 2021 IEEE.
Research Area(s)
- face recognition, face verification, generative adversarial networks, Image restoration, turbulence mitigation
Citation Format(s)
In: IEEE Transactions on Biometrics, Behavior, and Identity Science, Vol. 3, No. 2, 04.2021, p. 240-251.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review