VMV-GCN : Volumetric Multi-View Based Graph CNN for Event Stream Classification

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

5 Scopus Citations
View graph of relations


Related Research Unit(s)


Original languageEnglish
Pages (from-to)1976-1983
Journal / PublicationIEEE Robotics and Automation Letters
Issue number2
Online published6 Jan 2022
Publication statusPublished - Apr 2022


Event cameras can perceive pixel-level brightness changes to output asynchronous event streams, and have notable advantages in high temporal resolution, high dynamic range and low power consumption for challenging vision tasks. To apply existing learning methods on event data, many researchers integrate sparse events into dense frame-based representations which can work with convolutional neural networks directly. Although these works achieve high performance on event-based classification, their models need lots of parameters to process dense event frames which do not fit with the sparsity of event data. To utilize the sparse nature of events, we propose a voxel-wise graph learning model (VMV-GCN) for spatio-temporal feature learning on event streams. Specifically, we design the volumetric multi-view fusion module (VMVF) to extract spatial and temporal information from views of voxelized event data. Then we take representative event voxels as vertices and use a novel dual-graph construction strategy to connect them. By aggregating information based on relationships of vertices, the proposed dynamic neighborhood feature learning module (DNFL) can capture discriminative spatio-temporal features on dynamically updated graphs. Experiments show that our method achieves state-of-the-art performance with low model complexity on event-based classification tasks, such as object classification and action recognition. © 2022 IEEE.

Research Area(s)

  • Brightness, Cameras, Complexity theory, Deep learning for visual perception, object detection, segmentation and categorization