Abstract
In recent years, teacher-student distillation has become a prevalent approach for image anomaly detection in industrial and medical scenarios. However, current state-of-the-art methods often prioritize performance while overlooking the increased deployment cost introduced by asymmetric teacher-student architectures in practical applications. To address this issue, we propose a distillation framework based on vanilla Vision Transformers (ViT), which bridges the performance gap between symmetric and asymmetric teacher-student architectures. To mitigate the mimicry issue caused by directly applying symmetric ViT models for distillation, we design Anomaly Synthesis Module (ASM) and Dynamic Feature Selection Module (DFSM), which reduce the similarity between anomaly-related features extracted by the student and teacher network. Experiments conducted on five datasets, including MVTec AD, VisA, and BTAD, demonstrate that our method not only outperforms prior symmetric distillation models but also achieves superior anomaly localization compared to asymmetric teacher-student architectures. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2026.
| Original language | English |
|---|---|
| Title of host publication | Pattern Recognition and Computer Vision |
| Subtitle of host publication | 8th Chinese Conference, PRCV 2025, Shanghai, China, October 15–18, 2025, Proceedings, Part VI |
| Editors | Josef Kittler, Hongkai Xiong, Jian Yang |
| Place of Publication | Singapore |
| Publisher | Springer |
| Pages | 255-269 |
| ISBN (Electronic) | 978-981-95-5679-3 |
| ISBN (Print) | 9789819556786 |
| DOIs | |
| Publication status | Published - 2026 |
| Externally published | Yes |
| Event | 8th Chinese Conference on Pattern Recognition and Computer Vision (PRCV 2025) - Shanghai, China Duration: 15 Oct 2025 → 18 Oct 2025 |
Publication series
| Name | Lecture Notes in Computer Science |
|---|---|
| Volume | 16277 |
| ISSN (Print) | 0302-9743 |
| ISSN (Electronic) | 1611-3349 |
Conference
| Conference | 8th Chinese Conference on Pattern Recognition and Computer Vision (PRCV 2025) |
|---|---|
| Place | China |
| City | Shanghai |
| Period | 15/10/25 → 18/10/25 |
Funding
This work is supported in part by the National Natural Science Foundation of China under Grant 52402504.
Research Keywords
- Anomaly Detection
- Computer Vision
- Industrial Image
Fingerprint
Dive into the research topics of 'Revisiting Symmetric Teacher-Student Network Distillation for Anomaly Detection'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver