GAN-based Inter-Class Sample Generation for Contrastive Learning of Vein Image Representations

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

8 Scopus Citations
View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)249-262
Journal / PublicationIEEE Transactions on Biometrics, Behavior, and Identity Science
Volume4
Issue number2
Online published21 Feb 2022
Publication statusPublished - Apr 2022

Abstract

Biometric vein recognition using deep learning has shown promising performance recently. However, due to the lack of vein image training data, the performance is greatly limited. Although the use of traditional data augmentation can alleviate this problem to some extent, it can only expand the intra-class samples and is fundamentally limited to the intra-class space, resulting in limited performance improvement. In this paper, we tackle this deep learning data shortage problem by proposing a GAN-based framework that can generate arbitrary-pattern vein images, which can augment the training data with new vein classes. The proposed generation framework consists of three progressive synthetic steps, namely, generation of random vein patterns in the binary space, refinement of the binary vein patterns, and rendering them into grayscale vein images. Moreover, we use the synthetic dataset to pretrain the feature embedding network via unsupervised contrastive learning, which allows learning data augmentation-invariant and instance-separating representations. After that, we further fine-tune the embedding network on the real training data in a supervised manner. Our results show that highfidelity and diverse vein image samples can be generated to alleviate the problem of data shortage and improve the learning of features representations for biometric vein verification.

Research Area(s)

  • Biometrics (access control), data augmentation, feature extraction, generative adversarial network (GAN), unsupervised contrastive learning, Vein recognition

Citation Format(s)