Unsupervised Domain Adaptation via Deep Conditional Adaptation Network

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

14 Scopus Citations
View graph of relations

Author(s)

  • Pengfei Ge
  • Chuan-Xian Ren
  • Xiao-Lin Xu
  • Hong Yan

Related Research Unit(s)

Detail(s)

Original languageEnglish
Article number109088
Journal / PublicationPattern Recognition
Volume134
Online published1 Oct 2022
Publication statusPublished - Feb 2023

Abstract

Unsupervised domain adaptation (UDA) aims to generalize the supervised model trained on a source domain to an unlabeled target domain. Previous works mainly rely on the marginal distribution alignment of feature spaces, which ignore the conditional dependence between features and labels, and may suffer from negative transfer. To address this problem, some UDA methods focus on aligning the conditional distributions of feature spaces. However, most of these methods rely on class-specific Maximum Mean Discrepancy or adversarial training, which may suffer from mode collapse and training instability. In this paper, we propose a Deep Conditional Adaptation Network (DCAN) that aligns the conditional distributions by minimizing Conditional Maximum Mean Discrepancy, and extracts discriminant information from the target domain by maximizing the mutual information between samples and the prediction labels. Conditional Maximum Mean Discrepancy measures the difference between conditional distributions directly through their conditional embedding in Reproducing Kernel Hilbert Space, thus DCAN can be trained stably and converge fast. Mutual information can be expressed as the difference between the entropy and conditional entropy of the predicted category variable, thus DCAN can extract the discriminant information of individual and overall distributions in the target domain, simultaneously. In addition, DCAN can be used to address a special scenario, Partial UDA, where the target domain category is a subset of the source domain category. Experiments on both UDA and Partial UDA show that DCAN achieves superior classification performance over state-of-the-art methods.

Research Area(s)

  • Conditional maximum mean discrepancy, Deep learning, Domain adaptation, Feature extraction, Kernel method

Citation Format(s)

Unsupervised Domain Adaptation via Deep Conditional Adaptation Network. / Ge, Pengfei; Ren, Chuan-Xian; Xu, Xiao-Lin et al.
In: Pattern Recognition, Vol. 134, 109088, 02.2023.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review