Abstract
3D point cloud semantic segmentation is an important step for 3D indoors reconstruction. In recent years, many outstanding deep learning models have been proposed for semantic segmentation, which can achieve remarkable per-formance. However, it is found the index indicating se-mantic prediction accuracy in terms of structural components (e.g. columns, beams, etc.) in buildings is far from satisfying, lacking sufficient information for subsequent 3D reconstruction. For better segmenting and identifying structural components, this work proposes Architectural-Knowledge-Awarefeatures (AKAFs), i.e. Fl and F2, which are strategically incorporated into a developed two-stage training framework wherein outstanding semantic segmen-tation models are adopted as backbones. By incorporating F 1, which formalizes position distribution pattern of building structural components, semantic information can be explored preliminary in explicit stage (i.e. the first stage). The second stage is the implicit stage, where F2 is derived based on the Semantic and Relative Position Fusing Mod-ule (SRPFM), which implicitly introduces more relative po-sition information of building components for semantic seg-mentation. Extensive experiments have been conducted on the S3DIS dataset adopting three outstanding backbones. Results demonstrate that the proposed AKAFs can increase the accuracy of segmentation for structural components by more than 5%. As a result, the overall semantic segmen-tation performance increases by 2%. Even on the current SOTA model (PT-v3), the proposed AKAFs show promising semantic segmentation promotion. Portable and well-compatible with most point-based semantic segmentation models, AKAFs can effectively perceive more architectural characteristics hidden in indoor point clouds, especially prominent for points of structural components. © 2025 IEEE.
| Original language | English |
|---|---|
| Title of host publication | Proceedings - 2025 IEEE Winter Conference on Applications of Computer Vision, WACV 2025 |
| Place of Publication | Los Alamitos, Calif. |
| Publisher | IEEE |
| Pages | 2715-2724 |
| ISBN (Electronic) | 9798331510831 |
| ISBN (Print) | 9798331510848 |
| DOIs | |
| Publication status | Published - 2025 |
| Event | 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2025) - Tucson, United States Duration: 28 Feb 2025 → 4 Mar 2025 https://wacv2025.thecvf.com/ |
Publication series
| Name | Proceedings - IEEE Winter Conference on Applications of Computer Vision, WACV |
|---|---|
| ISSN (Print) | 2472-6737 |
| ISSN (Electronic) | 2642-9381 |
Conference
| Conference | 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2025) |
|---|---|
| Place | United States |
| City | Tucson |
| Period | 28/02/25 → 4/03/25 |
| Internet address |
Funding
This work was jointly supported by the Shenzhen Science and Technology Program #JCYJ20220818101019039, Hong Kong Research Grant Council Collaborative Research Fund #C7080-21GF, and City University of Hong Kong Strategic Interdisciplinary Research Grant #7020075. The experiments were carried out using the computational facilities, CityU Burgundy, managed and provided by the Computing Services Centre at the City University of Hong Kong (https://www.cityu.edu.hk/).
RGC Funding Information
- RGC-funded
Fingerprint
Dive into the research topics of 'Semantic Segmentation Method for Automated Indoor 3D Reconstruction based on Architectural-Knowledge-Aware Features'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver