TY - JOUR
T1 - Anomaly detection using large-scale multimode industrial data
T2 - An integration method of nonstationary kernel and autoencoder
AU - Wang, Kai
AU - Yan, Caoyin
AU - Mo, Yanfang
AU - Wang, Yalin
AU - Yuan, Xiaofeng
AU - Liu, Chenliang
PY - 2024/5
Y1 - 2024/5
N2 - Kernel methods and neural networks (NNs) are two mainstream nonlinear data modeling methods and have been widely applied to industrial process monitoring. However, they both present imperfect properties, so the relevant applications are limited. On the one hand, kernels are not so reconstructable, scalable, and robust to hyperparameters that they suffer performance degradation for large-scale data modeling and monitoring. On the other hand, the high-dimensional parameter space of NNs that is sorted to parameter initialization presents severe anomaly detection performance inconsistency, which makes the industry cautious about using NNs. Motivated by these facts, we propose to integrate kernels and NNs, forming a new model structure that is scalable, reconstructable, and performance-consistent. Specifically, a novel autoencoder-based nonstationary pattern selection kernel (AE-NPSK) is proposed by (1) selecting from the training set the critical edges and interior data as the centers of the radial basis functions in the hidden layers and (2) adaptively adjusting the kernel width in the training procedure. Also, the new NN has strong performance consistency, which facilitates the search for optimal parameters. Finally, we test the performance of the proposed method on the challenging multimode processes. The results validate the efficacy of the proposed method. © 2024 Elsevier Ltd
AB - Kernel methods and neural networks (NNs) are two mainstream nonlinear data modeling methods and have been widely applied to industrial process monitoring. However, they both present imperfect properties, so the relevant applications are limited. On the one hand, kernels are not so reconstructable, scalable, and robust to hyperparameters that they suffer performance degradation for large-scale data modeling and monitoring. On the other hand, the high-dimensional parameter space of NNs that is sorted to parameter initialization presents severe anomaly detection performance inconsistency, which makes the industry cautious about using NNs. Motivated by these facts, we propose to integrate kernels and NNs, forming a new model structure that is scalable, reconstructable, and performance-consistent. Specifically, a novel autoencoder-based nonstationary pattern selection kernel (AE-NPSK) is proposed by (1) selecting from the training set the critical edges and interior data as the centers of the radial basis functions in the hidden layers and (2) adaptively adjusting the kernel width in the training procedure. Also, the new NN has strong performance consistency, which facilitates the search for optimal parameters. Finally, we test the performance of the proposed method on the challenging multimode processes. The results validate the efficacy of the proposed method. © 2024 Elsevier Ltd
KW - Artificial neural network
KW - Autoencoder
KW - Kernel method
KW - Multimode process
KW - Process monitoring
KW - Radial basis function
UR - http://www.scopus.com/inward/record.url?scp=85181879774&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85181879774&origin=recordpage
U2 - 10.1016/j.engappai.2023.107839
DO - 10.1016/j.engappai.2023.107839
M3 - RGC 21 - Publication in refereed journal
SN - 0952-1976
VL - 131
JO - Engineering Applications of Artificial Intelligence
JF - Engineering Applications of Artificial Intelligence
M1 - 107839
ER -