Single-Frame-Based Deep View Synchronization for Unsynchronized Multicamera Surveillance

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

3 Scopus Citations
View graph of relations

Detail(s)

Original languageEnglish
Pages (from-to)10653-10667
Number of pages15
Journal / PublicationIEEE Transactions on Neural Networks and Learning Systems
Volume34
Issue number12
Online published16 May 2022
Publication statusPublished - Dec 2023

Link(s)

Abstract

Multicamera surveillance has been an active research topic for understanding and modeling scenes. Compared to a single camera, multicameras provide larger field-of-view and more object cues, and the related applications are multiview counting, multiview tracking, 3-D pose estimation or 3-D reconstruction, and so on. It is usually assumed that the cameras are all temporally synchronized when designing models for these multicamera-based tasks. However, this assumption is not always valid, especially for multicamera systems with network transmission delay and low frame rates due to limited network bandwidth, resulting in desynchronization of the captured frames across cameras. To handle the issue of unsynchronized multicameras, in this article, we propose a synchronization model that works in conjunction with existing deep neural network (DNN)-based multiview models, thus avoiding the redesign of the whole model. We consider two variants of the model, based on where in the pipeline the synchronization occurs, scene-level synchronization and camera-level synchronization. The view synchronization step and the task-specific view fusion and prediction step are unified in the same framework and trained in an end-to-end fashion. Our view synchronization models are applied to different DNNs-based multicamera vision tasks under the unsynchronized setting, including multiview counting and 3-D pose estimation, and achieve good performance compared to baselines.

Research Area(s)

  • Synchronization, Cameras, Task analysis, Pose estimation, Computational modeling, Geometry, Crowd counting, deep learning, image matching, pose estimation, surveillance, VIDEO SYNCHRONIZATION

Bibliographic Note

Research Unit(s) information for this publication is provided by the author(s) concerned.

Download Statistics

No data available