Skip to main navigation Skip to search Skip to main content

Thermal-Physics Inspired Cross-Modal Alignment for AAV-Based RGB-T Salient Object Detection

  • Haixiao Gao (Co-first Author)
  • , Yimin Zheng (Co-first Author)
  • , Linyou Xiao
  • , Yanhua Chen*
  • , Kechen Song
  • , Wenhao Wu*
  • , Zhi-Ri Tang*
  • *Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

2 Downloads (CityUHK Scholars)

Abstract

RGB–T salient object detection (SOD) for autonomous aerial vehicle (AAV) remote sensing aims to combine visible and thermal infrared imagery to precisely segment salient targets within complex urban and ecological scenes under low illumination, occlusion, and dynamic backgrounds. However, AAV-oriented RGB–T SOD still encounters three issues: (i) early fusion is susceptible to thermal noise and heat leakage, weakening saliency cues; (ii) cross-modal spatial misalignment hampers fine-grained correspondence; and (iii) coarse thermal boundaries blur local structures and perturb downstream reasoning. Inspired by these issues, we propose TPCA-Net, a unified language-thermal framework that injects physics-inspired thermo-signal priors into cross-modal fusion to stabilize the learning of both global context and local details. Specifically, we propose a Multi-dimensional Thermal Feature Enhancement (MTFE) to adaptively enhance thermodynamic cues while suppressing background leakage. In addition, we introduce a Heatmap Variation-Aware Dynamic Window (HVADW) that schedules pseudo-temporal dynamic windows to separate noise from structural variations. We further propose a Bi-directional Alignment-and-Fusion with Edge-Enhanced Decoding (BAF-ED) that performs bidirectional feature alignment with edge-aware decoding to restore sharp object boundaries. Extensive experiments demonstrate state-of-the-art performance and significant improvements in boundary precision in the remote sensing domain. © 2008-2012 IEEE.
Original languageEnglish
Pages (from-to)20923-20939
Number of pages17
JournalIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Volume19
Online published3 Jun 2026
DOIs
Publication statusPublished - 2026

Funding

This work was supported in part by the SEHS-2025-385(I) grant from the College of Professional and Continuing Education, an affiliate of The Hong Kong Polytechnic University, and in part by the National Natural Science Foundation of China under Grant 62401226.

Research Keywords

  • autonomous aerial vehicles (AAVs)
  • modal alignment
  • RGB–T salient object detection
  • thermal-physics priors
  • RGB-T salient object detection (SOD)

Publisher's Copyright Statement

  • This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

Fingerprint

Dive into the research topics of 'Thermal-Physics Inspired Cross-Modal Alignment for AAV-Based RGB-T Salient Object Detection'. Together they form a unique fingerprint.

Cite this