TY - JOUR
T1 - Refining Uncertain Features with Self-Distillation for Face Recognition and Person Re-Identification
AU - Ou, Fu-Zhao
AU - Chen, Xingyu
AU - Zhao, Kai
AU - Wang, Shiqi
AU - Wang, Yuan-Gen
AU - Kwong, Sam
N1 - Research Unit(s) information for this publication is provided by the author(s) concerned.
PY - 2024
Y1 - 2024
N2 - Deep recognition models aim to recognize targets with various quality levels in uncontrolled application circumstances, and typically low-quality images usually retard the recognition performance dramatically. As such, a straightforward solution is to restore low-quality input images as pre-processing during deployment. However, this scheme cannot guarantee that deep recognition features of the processed images are conducive to recognition accuracy. How deep recognition features of low-quality images can be refined during training to optimize recognition models has largely escaped research attention in the field of metric learning. In this paper, we propose a quality-aware feature refinement framework based on the dedicated quality priors obtained according to the recognition performance, and a novel quality self-distillation algorithm to learn recognition models. We further show that the proposed scheme can significantly boost the performance of the recognition model with two popular deep recognition tasks, including face recognition and person re-identification. Extensive experimental results provide sufficient evidence on the effectiveness and impressive generalization capability of the proposed framework. Moreover, our framework can be essentially integrated with existing state-of-the-art classification loss functions and network architectures, without extra computation costs during deployment. © 2024 IEEE.
AB - Deep recognition models aim to recognize targets with various quality levels in uncontrolled application circumstances, and typically low-quality images usually retard the recognition performance dramatically. As such, a straightforward solution is to restore low-quality input images as pre-processing during deployment. However, this scheme cannot guarantee that deep recognition features of the processed images are conducive to recognition accuracy. How deep recognition features of low-quality images can be refined during training to optimize recognition models has largely escaped research attention in the field of metric learning. In this paper, we propose a quality-aware feature refinement framework based on the dedicated quality priors obtained according to the recognition performance, and a novel quality self-distillation algorithm to learn recognition models. We further show that the proposed scheme can significantly boost the performance of the recognition model with two popular deep recognition tasks, including face recognition and person re-identification. Extensive experimental results provide sufficient evidence on the effectiveness and impressive generalization capability of the proposed framework. Moreover, our framework can be essentially integrated with existing state-of-the-art classification loss functions and network architectures, without extra computation costs during deployment. © 2024 IEEE.
KW - Feature refinement
KW - face recognition
KW - person reidentification
KW - recognition optimization
KW - quality self-distillation
UR - http://www.scopus.com/inward/record.url?scp=85184330037&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85184330037&origin=recordpage
U2 - 10.1109/TMM.2024.3358697
DO - 10.1109/TMM.2024.3358697
M3 - RGC 21 - Publication in refereed journal
SN - 1520-9210
VL - 26
SP - 6981
EP - 6995
JO - IEEE Transactions on Multimedia
JF - IEEE Transactions on Multimedia
ER -