Abstract
RGB–T salient object detection (SOD) for autonomous aerial vehicle (AAV) remote sensing aims to combine visible and thermal infrared imagery to precisely segment salient targets within complex urban and ecological scenes under low illumination, occlusion, and dynamic backgrounds. However, AAV-oriented RGB–T SOD still encounters three issues: (i) early fusion is susceptible to thermal noise and heat leakage, weakening saliency cues; (ii) cross-modal spatial misalignment hampers fine-grained correspondence; and (iii) coarse thermal boundaries blur local structures and perturb downstream reasoning. Inspired by these issues, we propose TPCA-Net, a unified language-thermal framework that injects physics-inspired thermo-signal priors into cross-modal fusion to stabilize the learning of both global context and local details. Specifically, we propose a Multi-dimensional Thermal Feature Enhancement (MTFE) to adaptively enhance thermodynamic cues while suppressing background leakage. In addition, we introduce a Heatmap Variation-Aware Dynamic Window (HVADW) that schedules pseudo-temporal dynamic windows to separate noise from structural variations. We further propose a Bi-directional Alignment-and-Fusion with Edge-Enhanced Decoding (BAF-ED) that performs bidirectional feature alignment with edge-aware decoding to restore sharp object boundaries. Extensive experiments demonstrate state-of-the-art performance and significant improvements in boundary precision in the remote sensing domain. © 2008-2012 IEEE.
| Original language | English |
|---|---|
| Pages (from-to) | 20923-20939 |
| Number of pages | 17 |
| Journal | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Volume | 19 |
| Online published | 3 Jun 2026 |
| DOIs | |
| Publication status | Published - 2026 |
Funding
This work was supported in part by the SEHS-2025-385(I) grant from the College of Professional and Continuing Education, an affiliate of The Hong Kong Polytechnic University, and in part by the National Natural Science Foundation of China under Grant 62401226.
Research Keywords
- autonomous aerial vehicles (AAVs)
- modal alignment
- RGB–T salient object detection
- thermal-physics priors
- RGB-T salient object detection (SOD)
Publisher's Copyright Statement
- This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/
Fingerprint
Dive into the research topics of 'Thermal-Physics Inspired Cross-Modal Alignment for AAV-Based RGB-T Salient Object Detection'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver