A bi-directional missing data imputation scheme based on LSTM and transfer learning for building energy data

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

35 Scopus Citations
View graph of relations

Author(s)

  • Jun Ma
  • Jack C.P. Cheng
  • Weiwei Chen
  • Mingzhu Wang
  • Chong Zhai

Detail(s)

Original languageEnglish
Article number109941
Journal / PublicationEnergy and Buildings
Volume216
Online published11 Mar 2020
Publication statusPublished - 1 Jun 2020

Abstract

Improving the energy efficiency of the buildings is a worldwide hot topic nowadays. To assist comprehensive analysis and smart management, high-quality historical data records of the energy consumption is one of the key bases. However, the energy data records in the real world always contain different kinds of problems. The most common problem is missing data. It is also one of the most frequently reported data quality problems in big data/machine learning/deep learning related literature in energy management. However, limited studied have been conducted to comprehensively discuss different kinds of missing data situations, including random missing, continuous missing, and large proportionally missing. Also, the methods used in previous literature often rely on linear statistical methods or traditional machine learning methods. Limited study has explored the feasibility of advanced deep learning and transfer learning techniques in this problem. To this end, this study proposed a methodology, namely the hybrid Long Short Term Memory model with Bi-directional Imputation and Transfer Learning (LSTM-BIT). It integrates the powerful modeling ability of deep learning networks and flexible transferability of transfer learning. A case study on the electric consumption data of a campus lab building was utilized to test the method. Results show that LSTM-BIT outperforms other methods with 4.24% to 47.15% lower RMSE under different missing rates.

Research Area(s)

  • Bi-directional estimation, Building energy, Deep learning, Electric power, Missing data, Transfer learning

Citation Format(s)

A bi-directional missing data imputation scheme based on LSTM and transfer learning for building energy data. / Ma, Jun; Cheng, Jack C.P.; Jiang, Feifeng; Chen, Weiwei; Wang, Mingzhu; Zhai, Chong.

In: Energy and Buildings, Vol. 216, 109941, 01.06.2020.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review