跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 28 天前AI 評分37

GeoUG 如何透過生成提升空間理解與推理

Learning and Reasoning with Geometry: How Generation Helps Spatial Understanding

AI 導讀

GeoUG 結合深度圖與多視角生成,並在推理時自適應地生成幾何證據,以提升空間推理能力。在 CV-Bench-3D、3DCueBench 和 DA-2K 上,其準確率分別為 97.9%、90.8% 和 94.2%。相比每次都生成幾何證據,GeoUG 使用的生成呼叫次數更少。

正文

Published on Oct 26

Authors:

,

,

,

,

Abstract

GeoUG improves spatial reasoning by combining depth and multi-view generation with adaptive geometric verification during inference.

Image and video generators can produce spatially consistent visual content, but how to use this capability to improve spatial understanding remains underexplored. We study this problem from two perspectives: geometric supervision during training and explicit geometric evidence during inference. To this end, we introduce a unified geometric understanding and generation model (GeoUG) that integrates depth and multi-view generation with spatial understanding. First, we design a multi-scale depth codec that enables metric-depth generation using a pretrained visual autoencoder, and show that joint training yields task-dependent gains in spatial understanding. Second, we introduce 3DCueBench to control geometric difficulty while balancing selected 2D cues, and find that generated depth provides larger reasoning gains on questions requiring fine-grained geometric discrimination. Building on this finding, we develop adaptive interleaved reasoning, in which GeoUG first drafts an answer and then decides whether to generate geometric evidence to confirm or revise it. We train this decision through reinforcement learning, balancing accuracy gains over retaining the draft against generation cost. GeoUG achieves circular accuracies of 97.9%, 90.8%, and 94.2% on CV-Bench-3D, 3DCueBench, and DA-2K with fewer generation calls than always generating.

View arXiv page View PDF Project page GitHub 4 Add to collection

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.36022 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.36022 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.36022 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co