LICFM3-SLAM: LiDAR-Inertial-Camera Fusion and Multi-modal Multi-level Matching for Bionic Quadruped Inspection Robot Mapping

Haibing Zhang, Lin Li, Andong Jiang, Jiajun Xu, Huan Shen, Youfu Li, Aihong Ji*, Zhongyuan Wang*

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

In comparison to wheeled robots, the locomotion of bionic quadruped robots is more vigorous. Mapping systems should maintain satisfactory robustness and accuracy in various complex real-world scenarios, even when the robot's body experiences intense shaking. To address these challenges, this study proposes a Simultaneous Localization and Mapping (SLAM) system based on LiDAR-inertial-camera fusion and a multi-modal multi-layer matching algorithm(LICFM3-SLAM). First, a tightly coupled strategy is utilized to fuse LiDAR, inertial, and camera information, introducing a visual-inertial odometry (VIO) subsystem based on adaptive graph inference; thus, high-precision and robust robot state estimation are achieved. Second, inspired by human spatial cognition, the study proposes a multimodal multi-layer matching algorithm and utilizes observation data obtained from the camera and LiDAR, thereby achieving accurate and robust data association. Finally, incremental poses are optimized using factor graph optimization methods; thus, a globally consistent 3D point cloud map is constructed. The proposed system is tested on a public benchmark dataset and applied to a bionic quadruped inspection robot(BQIR), and experiments are conducted in various challenging indoor and outdoor large-scale scenarios. The results reveal that LICFM3-SLAM exhibits high robustness and mapping accuracy while meeting real-time requirements.

© 2025 IEEE. All rights reserved, including rights for text and data mining, and training of artificial intelligence and similar technologies. Personal use is permitted, but republication/redistribution requires IEEE permission.
Original languageEnglish
Article number7506217
JournalIEEE Transactions on Instrumentation and Measurement
Volume74
Online published28 Mar 2025
DOIs
Publication statusPublished - 2025

Research Keywords

  • Bionic Quadruped Robot
  • Mapping
  • Sensor Fusion
  • SLAM

Fingerprint

Dive into the research topics of 'LICFM3-SLAM: LiDAR-Inertial-Camera Fusion and Multi-modal Multi-level Matching for Bionic Quadruped Inspection Robot Mapping'. Together they form a unique fingerprint.

Cite this