Skip to main navigation Skip to search Skip to main content

Partner-Assisted Learning for Few-Shot Image Classification

  • Jiawei Ma (Co-first Author)
  • , Hanchen Xie (Co-first Author)
  • , Guangxing Han
  • , Shih-Fu Chang
  • , Aram Galstyan
  • , Wael Abd-Almageed

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Few-shot Learning has been studied to mimic human visual capabilities and learn effective models without the need of exhaustive human annotation. Even though the idea of meta-learning for adaptation has dominated the few-shot learning methods, how to train a feature extractor is still a challenge. In this paper, we focus on the design of training strategy to obtain an elemental representation such that the prototype of each novel class can be estimated from a few labeled samples. We propose a two-stage training scheme, Partner-Assisted Learning (PAL), which first trains a Partner Encoder to model pair-wise similarities and extract features serving as soft-anchors, and then trains a Main Encoder by aligning its outputs with soft-anchors while attempting to maximize classification performance. Two alignment constraints from logit-level and feature-level are designed individually. For each few-shot task, we perform prototype classification. Our method consistently outperforms the state-of-the-art methods on four benchmarks. Detailed ablation studies of PAL are provided to justify the selection of each component involved in training. © 2021 IEEE.
Original languageEnglish
Title of host publicationProceedings - 2021 IEEE/CVF International Conference on Computer Vision, ICCV 2021
PublisherIEEE
Pages10553-10562
ISBN (Electronic)978-1-6654-2812-5
ISBN (Print)978-1-6654-2813-2
DOIs
Publication statusPublished - Oct 2021
Externally publishedYes
Event18th IEEE/CVF International Conference on Computer Vision (ICCV 2021) - Virtual, Montreal, Canada
Duration: 11 Oct 202117 Oct 2021
https://iccv2021.thecvf.com/home

Publication series

NameProceedings of the IEEE International Conference on Computer Vision
ISSN (Print)1550-5499
ISSN (Electronic)2380-7504

Conference

Conference18th IEEE/CVF International Conference on Computer Vision (ICCV 2021)
Abbreviated titleICCV2021
PlaceCanada
CityMontreal
Period11/10/2117/10/21
Internet address

Funding

This material is based on research sponsored by Air Force Research Laboratory (AFRL) under agreement number FA8750-19-1-1000. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation therein. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Laboratory, DARPA or the U.S. Government.

Fingerprint

Dive into the research topics of 'Partner-Assisted Learning for Few-Shot Image Classification'. Together they form a unique fingerprint.

Cite this