Skip to main navigation Skip to search Skip to main content

Partial Domain Adaptation via Importance Sampling-Based Shift Correction

  • Cheng-Jun Guo
  • , Chuan-Xian Ren*
  • , You-Wei Luo
  • , Xiao-Lin Xu
  • , Hong Yan
  • *Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

Partial domain adaptation (PDA) is a challenging task in real-world machine learning scenarios. It aims to transfer knowledge from a labeled source domain to a related unlabeled target domain, where the support set of the source label distribution subsumes the target one. Previous PDA works managed to correct the label distribution shift by weighting samples in the source domain. However, the simple reweighing technique cannot explore the latent structure and sufficiently use the labeled data, and then models are prone to over-fitting on the source domain. In this work, we propose a novel importance sampling-based shift correction (IS2C) method, where new labeled data are sampled from a built sampling domain, whose label distribution is supposed to be the same as the target domain, to characterize the latent structure and enhance the generalization ability of the model. We provide theoretical guarantees for IS2C by proving that the generalization error can be sufficiently dominated by IS2C. In particular, by implementing sampling with the mixture distribution, the extent of shift between source and sampling domains can be connected to generalization error, which provides an interpretable way to build IS2C. To improve knowledge transfer, an optimal transport-based independence criterion is proposed for conditional distribution alignment, where the computation of the criterion can be adjusted to reduce the complexity from O(n3) to O(n2) in realistic PDA scenarios. Extensive experiments on PDA benchmarks validate the theoretical results and demonstrate the effectiveness of our IS2C over existing methods. © 2025 IEEE.
Original languageEnglish
Pages (from-to)5009-5022
Number of pages14
JournalIEEE Transactions on Image Processing
Volume34
Online published1 Aug 2025
DOIs
Publication statusPublished - 2025

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 62376291; in part by Guangdong Basic and Applied Basic Research Foundation under Grant 2023B1515020004; in part by the Science and Technology Program of Guangzhou under Grant 2024A04J6413; in part by the Fundamental Research Funds for the Central Universities, Sun Yat-sen University under Grant 24xkjc013; in part by Hong Kong Innovation and Technology Commission [InnoHK Project of Center for Intelligent Multidimensional Data Analysis (CIMDA) Limited]; and in part by the Institute of Digital Medicine, City University of Hong Kong under Project 9229503.

Research Keywords

  • Partial domain adaptation
  • importance sampling
  • generalization error analysis
  • label shift
  • conditional shift

Fingerprint

Dive into the research topics of 'Partial Domain Adaptation via Importance Sampling-Based Shift Correction'. Together they form a unique fingerprint.

Cite this