Skip to main navigation Skip to search Skip to main content

Semantic Segmentation Method for Automated Indoor 3D Reconstruction based on Architectural-Knowledge-Aware Features

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

3D point cloud semantic segmentation is an important step for 3D indoors reconstruction. In recent years, many outstanding deep learning models have been proposed for semantic segmentation, which can achieve remarkable per-formance. However, it is found the index indicating se-mantic prediction accuracy in terms of structural components (e.g. columns, beams, etc.) in buildings is far from satisfying, lacking sufficient information for subsequent 3D reconstruction. For better segmenting and identifying structural components, this work proposes Architectural-Knowledge-Awarefeatures (AKAFs), i.e. Fl and F2, which are strategically incorporated into a developed two-stage training framework wherein outstanding semantic segmen-tation models are adopted as backbones. By incorporating F 1, which formalizes position distribution pattern of building structural components, semantic information can be explored preliminary in explicit stage (i.e. the first stage). The second stage is the implicit stage, where F2 is derived based on the Semantic and Relative Position Fusing Mod-ule (SRPFM), which implicitly introduces more relative po-sition information of building components for semantic seg-mentation. Extensive experiments have been conducted on the S3DIS dataset adopting three outstanding backbones. Results demonstrate that the proposed AKAFs can increase the accuracy of segmentation for structural components by more than 5%. As a result, the overall semantic segmen-tation performance increases by 2%. Even on the current SOTA model (PT-v3), the proposed AKAFs show promising semantic segmentation promotion. Portable and well-compatible with most point-based semantic segmentation models, AKAFs can effectively perceive more architectural characteristics hidden in indoor point clouds, especially prominent for points of structural components. © 2025 IEEE.
Original languageEnglish
Title of host publicationProceedings - 2025 IEEE Winter Conference on Applications of Computer Vision, WACV 2025
Place of PublicationLos Alamitos, Calif.
PublisherIEEE
Pages2715-2724
ISBN (Electronic)9798331510831
ISBN (Print)9798331510848
DOIs
Publication statusPublished - 2025
Event2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2025) - Tucson, United States
Duration: 28 Feb 20254 Mar 2025
https://wacv2025.thecvf.com/

Publication series

NameProceedings - IEEE Winter Conference on Applications of Computer Vision, WACV
ISSN (Print)2472-6737
ISSN (Electronic)2642-9381

Conference

Conference2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2025)
PlaceUnited States
CityTucson
Period28/02/254/03/25
Internet address

Funding

This work was jointly supported by the Shenzhen Science and Technology Program #JCYJ20220818101019039, Hong Kong Research Grant Council Collaborative Research Fund #C7080-21GF, and City University of Hong Kong Strategic Interdisciplinary Research Grant #7020075. The experiments were carried out using the computational facilities, CityU Burgundy, managed and provided by the Computing Services Centre at the City University of Hong Kong (https://www.cityu.edu.hk/).

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Semantic Segmentation Method for Automated Indoor 3D Reconstruction based on Architectural-Knowledge-Aware Features'. Together they form a unique fingerprint.

Cite this