Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection : A Benchmark and Algorithms
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 10750-10760 |
Journal / Publication | IEEE Transactions on Cybernetics |
Volume | 52 |
Issue number | 10 |
Online published | 24 Mar 2021 |
Publication status | Published - Oct 2022 |
Externally published | Yes |
Link(s)
Abstract
Joint detection of drivable areas and road anomalies is very important for mobile robots. Recently, many semantic segmentation approaches based on convolutional neural networks (CNNs) have been proposed for pixelwise drivable area and road anomaly detection. In addition, some benchmark datasets, such as KITTI and Cityscapes, have been widely used. However, the existing benchmarks are mostly designed for self-driving cars. There lacks a benchmark for ground mobile robots, such as robotic wheelchairs. Therefore, in this article, we first build a drivable area and road anomaly detection benchmark for ground mobile robots, evaluating existing state-of-the-art (SOTA) single-modal and data-fusion semantic segmentation CNNs using six modalities of visual features. Furthermore, we propose a novel module, referred to as the dynamic fusion module (DFM), which can be easily deployed in existing data-fusion networks to fuse different types of visual features effectively and efficiently. The experimental results show that the transformed disparity image is the most informative visual feature and the proposed DFM-RTFNet outperforms the SOTAs. In addition, our DFM-RTFNet achieves competitive performance on the KITTI road benchmark. © 2021 IEEE.
Research Area(s)
- Deep learning in robotics and automation, dynamic fusion, mobile robots, semantic scene understanding
Citation Format(s)
Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection: A Benchmark and Algorithms. / Wang, Hengli; Fan, Rui; Sun, Yuxiang et al.
In: IEEE Transactions on Cybernetics, Vol. 52, No. 10, 10.2022, p. 10750-10760.
In: IEEE Transactions on Cybernetics, Vol. 52, No. 10, 10.2022, p. 10750-10760.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review