GAN-based Inter-Class Sample Generation for Contrastive Learning of Vein Image Representations
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 249-262 |
Journal / Publication | IEEE Transactions on Biometrics, Behavior, and Identity Science |
Volume | 4 |
Issue number | 2 |
Online published | 21 Feb 2022 |
Publication status | Published - Apr 2022 |
Link(s)
Abstract
Biometric vein recognition using deep learning has shown promising performance recently. However, due to the lack of vein image training data, the performance is greatly limited. Although the use of traditional data augmentation can alleviate this problem to some extent, it can only expand the intra-class samples and is fundamentally limited to the intra-class space, resulting in limited performance improvement. In this paper, we tackle this deep learning data shortage problem by proposing a GAN-based framework that can generate arbitrary-pattern vein images, which can augment the training data with new vein classes. The proposed generation framework consists of three progressive synthetic steps, namely, generation of random vein patterns in the binary space, refinement of the binary vein patterns, and rendering them into grayscale vein images. Moreover, we use the synthetic dataset to pretrain the feature embedding network via unsupervised contrastive learning, which allows learning data augmentation-invariant and instance-separating representations. After that, we further fine-tune the embedding network on the real training data in a supervised manner. Our results show that highfidelity and diverse vein image samples can be generated to alleviate the problem of data shortage and improve the learning of features representations for biometric vein verification.
Research Area(s)
- Biometrics (access control), data augmentation, feature extraction, generative adversarial network (GAN), unsupervised contrastive learning, Vein recognition
Citation Format(s)
GAN-based Inter-Class Sample Generation for Contrastive Learning of Vein Image Representations. / Ou, Wei-Feng; Po, Lai-Man; Zhou, Chang et al.
In: IEEE Transactions on Biometrics, Behavior, and Identity Science, Vol. 4, No. 2, 04.2022, p. 249-262.
In: IEEE Transactions on Biometrics, Behavior, and Identity Science, Vol. 4, No. 2, 04.2022, p. 249-262.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review