Skip to main navigation Skip to search Skip to main content

Revisiting Symmetric Teacher-Student Network Distillation for Anomaly Detection

Qunyi Zhang, Jiaqi Liu, Guoyang Xie, Liewen Liao, Yongming Chen, Xiaoning Lei, Annan Shu*, Guannan Jiang, Songan Zhang*

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

In recent years, teacher-student distillation has become a prevalent approach for image anomaly detection in industrial and medical scenarios. However, current state-of-the-art methods often prioritize performance while overlooking the increased deployment cost introduced by asymmetric teacher-student architectures in practical applications. To address this issue, we propose a distillation framework based on vanilla Vision Transformers (ViT), which bridges the performance gap between symmetric and asymmetric teacher-student architectures. To mitigate the mimicry issue caused by directly applying symmetric ViT models for distillation, we design Anomaly Synthesis Module (ASM) and Dynamic Feature Selection Module (DFSM), which reduce the similarity between anomaly-related features extracted by the student and teacher network. Experiments conducted on five datasets, including MVTec AD, VisA, and BTAD, demonstrate that our method not only outperforms prior symmetric distillation models but also achieves superior anomaly localization compared to asymmetric teacher-student architectures. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2026.
Original languageEnglish
Title of host publicationPattern Recognition and Computer Vision
Subtitle of host publication8th Chinese Conference, PRCV 2025, Shanghai, China, October 15–18, 2025, Proceedings, Part VI
EditorsJosef Kittler, Hongkai Xiong, Jian Yang
Place of PublicationSingapore
PublisherSpringer 
Pages255-269
ISBN (Electronic)978-981-95-5679-3
ISBN (Print)9789819556786
DOIs
Publication statusPublished - 2026
Externally publishedYes
Event8th Chinese Conference on Pattern Recognition and Computer Vision (PRCV 2025) - Shanghai, China
Duration: 15 Oct 202518 Oct 2025

Publication series

NameLecture Notes in Computer Science
Volume16277
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference8th Chinese Conference on Pattern Recognition and Computer Vision (PRCV 2025)
PlaceChina
CityShanghai
Period15/10/2518/10/25

Funding

This work is supported in part by the National Natural Science Foundation of China under Grant 52402504.

Research Keywords

  • Anomaly Detection
  • Computer Vision
  • Industrial Image

Fingerprint

Dive into the research topics of 'Revisiting Symmetric Teacher-Student Network Distillation for Anomaly Detection'. Together they form a unique fingerprint.

Cite this