Skip to main navigation Skip to search Skip to main content

Spatiotemporal Observer Design for Predictive Learning of High-Dimensional Data

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

Although deep learning-based methods have shown great success in spatiotemporal predictive learning, the frameworks of those models are mainly designed by intuition. How to make spatiotemporal forecasting with theoretical guarantees is still a challenging issue. In this work, we tackle this problem by applying domain knowledge from the dynamical system to the framework design of deep learning models. An observer theory-guided deep learning architecture, called Spatiotemporal Observer, is designed for predictive learning of high dimensional data. The characteristics of the proposed framework are twofold: firstly, it provides the generalization error bound and convergence guarantee for spatiotemporal prediction; secondly, dynamical regularization is introduced to enable the model to learn system dynamics better during training. Further experimental results demonstrate that this framework could effectively model the spatiotemporal dynamics and make accurate predictions in both one-step-ahead and multi-step-ahead forecasting scenarios. © 2025 IEEE.
Original languageEnglish
Pages (from-to)6215-6227
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume47
Issue number8
Online published1 Apr 2025
DOIs
Publication statusPublished - Aug 2025

Research Keywords

  • spatiotemporal observer design
  • Spatiotemporal predictive learning
  • theory-guided deep learning
  • video prediction

Fingerprint

Dive into the research topics of 'Spatiotemporal Observer Design for Predictive Learning of High-Dimensional Data'. Together they form a unique fingerprint.

Cite this