Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection

Yu Guo, Shengfeng He*, Yuxu Lu, Haonan An, Yihang Tao, Huilin Zhu, Jingxian Liu, Yuguang Fang

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Maritime object detection is essential for navigation safety, surveillance, and autonomous operations, yet constrained by two key challenges: the scarcity of annotated maritime data and poor generalization across various maritime attributes (e.g., object category, viewpoint, location, and imaging environment). To address these challenges, we propose Neptune-X, a data-centric generative-selection framework that enhances training effectiveness by leveraging synthetic data generation with task-aware sample selection. From the generation perspective, we develop X-to-Maritime, a multi-modality-conditioned generative model that synthesizes diverse and realistic maritime scenes. A key component is the Bidirectional Object-Water Attention module, which captures boundary interactions between objects and their aquatic surroundings to improve visual fidelity. To further improve downstream tasking performance, we propose Attribute-correlated Active Sampling, which dynamically selects synthetic samples based on their task relevance. To support robust benchmarking, we construct the Maritime Generation Dataset, the first dataset tailored for generative maritime learning, encompassing a wide range of semantic conditions. Extensive experiments demonstrate that our approach sets a new benchmark in maritime scene synthesis, significantly improving detection accuracy, particularly in challenging and previously underrepresented settings. The code is available at https://github.com/gy65896/Neptune-X.
Original languageEnglish
Title of host publicationThe Thirty-Ninth Annual Conference on Neural Information Processing Systems
Publication statusOnline published - 19 Sept 2025
Event39th Annual Conference on Neural Information Processing Systems (NeurIPS 2025) - San Diego, United States
Duration: 2 Dec 20257 Dec 2025
https://neurips.cc/Conferences/2025

Conference

Conference39th Annual Conference on Neural Information Processing Systems (NeurIPS 2025)
Abbreviated titleNeurIPS 2025
PlaceUnited States
CitySan Diego
Period2/12/257/12/25
Internet address

Funding

This work is supported by the JC STEM Lab of Smart City funded by The Hong Kong Jockey Club Charities Trust (2023-0108), the Hong Kong SAR Government under the Global STEM Professorship and Research Talent Hub, the Guangdong Natural Science Funds for Distinguished Young Scholars (Grant 2023B1515020097), the National Research Foundation Singapore under the AI Singapore Programme (AISG Award No: AISG4-TC-2025-018-SGKR), and the Lee Kong Chian Fellowships.

Fingerprint

Dive into the research topics of 'Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection'. Together they form a unique fingerprint.

Cite this