Projects per year
Abstract
To recognize objects of the unseen classes, most existing Zero-Shot Learning(ZSL) methods first learn a compatible projection function between the common semantic space and the visual space based on the data of source seen classes, then directly apply it to the target unseen classes. However, for data in the wild, distributions between the source and target domain might not match well, thus causing the well-known domain shift problem. Based on the observation that visual features of test instances can be separated into different clusters, we propose a new visual structure constraint on class centers for transductive ZSL, to improve the generality of the projection function (i.e.alleviate the above domain shift problem). Specifically, three different strategies (symmetric Chamfer-distance, Bipartite matching distance, and Wasserstein distance) are adopted to align the projected unseen semantic centers and visual cluster centers of test instances. We also propose two new training strategies to handle the data in the wild, where many unrelated images in the test dataset may exist. This realistic setting has never been considered in previous methods. Extensive experiments demonstrate that the proposed visual structure constraint brings substantial performance gain consistently and the new training strategies make it generalize well for data in the wild. The source code is available at https://github.com/raywzy/VSC.
| Original language | English |
|---|---|
| Pages (from-to) | 1893–1909 |
| Number of pages | 17 |
| Journal | International Journal of Computer Vision |
| Volume | 129 |
| Issue number | 6 |
| Online published | 19 Apr 2021 |
| DOIs | |
| Publication status | Published - Jun 2021 |
Bibliographical note
Research Unit(s) information for this publication is provided by the author(s) concerned.Research Keywords
- Computer vision
- Visual structure constraint
- Zero-shot learning
Fingerprint
Dive into the research topics of 'Visual Structure Constraint for Transductive Zero-Shot Learning in the Wild'. Together they form a unique fingerprint.Projects
- 1 Finished
-
ECS: A Deep Learning Pipeline to Restore Images or Videos with Unknown and Mixed Defects
LIAO, J. (Principal Investigator / Project Coordinator)
1/08/19 → 24/07/23
Project: Research
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver