Automatic Rail Component Detection Based on AttnConv-net

Tiange Wang, Zijun Zhang*, Fangfang Yang, Kwok-Leung Tsui

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

16 Citations (Scopus)

Abstract

The automatic detection of major rail components using railway images is beneficial to ensure the rail transport safety. In this paper, we propose an attention-powered deep convolutional network (AttnConv-net) to detect multiple rail components including the rail, clips, and bolts. The proposed method consists of a deep convolutional neural network (DCNN) as the backbone, cascading attention blocks (CAB), and two feed forward networks (FFN). Two types of positional embedding are applied to enrich information in latent features extracted from the backbone. Based on processed latent features, the CAB aims to learn the local context of rail components including their categories and component boundaries. Final predictions of categories and bounding boxes are generated via two feed forward networks implemented in parallel. To enhance the detection of small components, various data augmentation methods are employed in training process. The effectiveness of the proposed AttnConv-net is validated with one real dataset and another synthesized dataset. Compared with classic convolutional neural network based methods, our proposed method simplifies the detection pipeline by eliminating the need of prior- and post-processing, which offers a new speed-quality solution to enable faster and more accurate image-based rail component detections.
Original languageEnglish
Pages (from-to)2379-2388
JournalIEEE Sensors Journal
Volume22
Issue number3
Online published3 Dec 2021
DOIs
Publication statusPublished - 1 Feb 2022

Research Keywords

  • Attention mechanism
  • data augmentation
  • deep learning
  • Fasteners
  • Feature extraction
  • rail component detection
  • Rail transportation
  • Rails
  • railway inspection
  • Sensors
  • Task analysis
  • Training

Fingerprint

Dive into the research topics of 'Automatic Rail Component Detection Based on AttnConv-net'. Together they form a unique fingerprint.

Cite this