GeoSET: Generalist Foundation Model for SAR-to-EO Image Translation
GeoSET: Generalist Foundation Model for SAR-to-EO Image Translation
GeoSET 提出一種面向 SAR-to-EO 影像轉換的通用模型,以單一預訓練母模型適配不同下游數據集。研究整理超過 300 萬組 SAR-EO 影像配對,涵蓋逾 1,000 萬筆 SAR 觀測;在六項下游基準測試中,GeoSET 以全量微調或 LoRA 達到 FID 和 DISTS 的最先進結果。 LoRA 每個數據集約需一小時,只更新生成器 0.60% 的參數。
Published on Sep 26
Authors:
Abstract
Paired synthetic aperture radar (SAR) and electro-optical (EO) imagery is increasingly available across sensors, resolutions, and geographic regions. Yet existing SAR-to-EO image translation (SET) methods are typically trained on a single, limited-scale dataset, producing models specialized to particular sensing conditions. We introduce GeoSET, the first generalist model for SET, built around a single pretrained parent that is adapted to downstream datasets under a common protocol. We curate over 3 million high-quality SAR--EO pairs from a collection of more than 10 million SAR observations, spanning diverse sensors, spatial resolutions, and ground sampling distances. To bridge the modality gap between SAR observations and a pretrained image generator, we develop a speckle-robust SAR encoder and pretrain the conditional generator on this heterogeneous corpus. The resulting parent supports efficient adaptation across downstream datasets through low-rank adaptation (LoRA), updating only 0.60% of the generator parameters and requiring approximately one hour per dataset. Across six downstream benchmarks, GeoSET achieves state-of-the-art results in FID and DISTS with full fine-tuning or LoRA, demonstrating effective transfer across heterogeneous SAR-EO domains.
View arXiv page View PDF Project page GitHub 3 Add to collection
Get this paper in your agent:
hf papers read 2609.37496
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 1
Image-to-Image • Updated about 3 hours ago • 1JeonghyeokDo/GeoSET
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2609.37496 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2609.37496 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co