A dynamic ensemble algorithm for anomaly detection in IoT imbalanced data streams

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

1 Scopus Citations
View graph of relations

Author(s)

  • Jun Jiang
  • Fagui Liu
  • Yongheng Liu
  • Quan Tang
  • Bin Wang
  • Guoxiang Zhong

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)250-257
Journal / PublicationComputer Communications
Volume194
Online published28 Jul 2022
Publication statusPublished - 1 Oct 2022

Abstract

With the rapid development of ambient intelligence (AmI) in the Internet of Things (IoT), many data streams are generated from sensing devices in intelligent scenarios. Due to the deployment issues of IoT devices and the system's complexity, abnormal behavior is inevitable, resulting in imbalanced data categories. Moreover, data streams generated in IoT systems are dynamic, continuous, and as the environment changes, further increasing the difficulty of anomaly detection. Therefore, we model the monitored historical and current data from the perspective of dynamic imbalanced data streams classification to discover abnormal behaviors in IoT systems. In this paper we propose a dynamic ensemble algorithm for anomaly detection in IoT environments. First the abnormal data samples are synthesized by the borderline-synthetic minority over-sampling technique (Borderline-SMOTE) to relieve the sample imbalance problem. Then considering the dynamics and continuity of data streams we adopt a chunk-based strategy to train a LightGBM classifier for each chunk of data to adapt to the current data distribution. To improve the ensemble model's processing efficiency and anomaly detection accuracy we adopt a dynamic weighting strategy for base classifiers and remove the classifier whose accuracy performance is lower than the threshold. Finally we evaluate our proposed algorithm by conducting comparative experiments on real-world data streams. Experimental results show that our proposed algorithm outperforms the comparative anomaly detection methods in IoT scenarios.

Research Area(s)

  • Ambient intelligence, Anomaly detection, Data stream, Imbalanced classification, Internet of Things (IoT)

Citation Format(s)

A dynamic ensemble algorithm for anomaly detection in IoT imbalanced data streams. / Jiang, Jun; Liu, Fagui; Liu, Yongheng; Tang, Quan; Wang, Bin; Zhong, Guoxiang; Wang, Weizheng.

In: Computer Communications, Vol. 194, 01.10.2022, p. 250-257.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review