Skip to main navigation Skip to search Skip to main content

Vision-Language Navigation for Indoor Construction Site Inspection using Quadruped Robots

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

Abstract

Automated inspection of indoor construction sites is pivotal for enhancing project quality management and operational safety. Mobile inspection robots possess the potential to gradually replace human workers. However, characterized by high dynamics, clutter, and visual monotony, construction environments pose severe navigational challenges. Current SLAM solutions impose heavy computational burdens and face robustness challenges in such environments. Therefore, this study proposes a Vision-Language Navigation framework tailored for indoor construction site inspection. Specifically, we leverage the robust generalization of pre-trained Vision-Language Models (VLMs) to construct a two-stage navigation agent controlling quadruped robots. In the first stage, we utilize building floor plans and scene graphs to plan movement paths within the facility, thereby generating detailed navigation sub-tasks and path descriptions. In the second stage, the navigation agent outputs the subsequent action sequence based on current sub-task information and continuously updated historical navigation memory until the navigation task is completed. The proposed framework was validated within a custom three-story educational building construction scenario simulated in the Habitat3.0 simulator. Experimental results demonstrate that the path generation module achieves high semantic alignment with ground truth. Furthermore, the agent exhibits execution capabilities in challenging scenarios, such as texture-less cross-room traversal and stair climbing. This work provides a new technical pathway for achieving low-cost and flexible intelligent construction inspection, advancing construction automation. © 2026 International Association on Automation and Robotics in Construction. All Rights Reserved.
Original languageEnglish
Title of host publicationProceedings of the 43rd International Symposium on Automation and Robotics in Construction
PublisherInternational Association for Automation and Robotics in Construction (IAARC)
Pages650-657
ISBN (Print)9780645832235
DOIs
Publication statusPublished - Jun 2026
Event43rd International Symposium on Automation and Robotics in Construction (ISARC 2026): Constructing the Future: Sustainable, Smart, and Lean - National University of Singapore, Singapore
Duration: 22 Jun 2026 → 26 Jul 2026
https://www.iaarc.org/isarc-2026

Publication series

NameProceedings of the International Symposium on Automation and Robotics in Construction
ISSN (Electronic)2413-5844

Conference

Conference43rd International Symposium on Automation and Robotics in Construction (ISARC 2026)
Abbreviated titleISARC2026
PlaceSingapore
Period22/06/26 → 26/07/26
Internet address

Funding

The authors gratefully acknowledge the financial support provided by the Guangdong Basic and Applied Basic Research Foundation (Grant No. 2025A1515010190) and the National Natural Science Foundation of China (Grant No. 72404233).

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 4 - Quality Education
    SDG 4 Quality Education

Research Keywords

  • Building information modeling (BIM)
  • Construction inspection
  • Quadruped robots
  • Vision-language models
  • Vision-language navigation

Fingerprint

Dive into the research topics of 'Vision-Language Navigation for Indoor Construction Site Inspection using Quadruped Robots'. Together they form a unique fingerprint.

Cite this