ThinkDrag: Semantic Drag-Based Image Editing with Visual Reasoning
ThinkDrag: Semantic Drag-Based Image Editing with Visual Reasoning
ThinkDrag 是一個結合視覺推理的多模態框架,讓拖曳式圖片編輯能根據點位限制理解物件及場景層級的語義轉換。它可在生成圖片前輸出推理過程,並以 Drag Endpoint Markers 為拖曳提供圖像空間中的對應訊號;研究亦建立配對推理過程的監督數據集,並推出評估具挑戰性編輯情境的 DragBench++。
Published on Oct 9
Authors:
,
,
,
Abstract
Drag-based image editing provides an intuitive interface for spatially controlled image manipulation by allowing users to specify handle and target points. Existing methods have made substantial progress through optimization-based, one-step, and feed-forward formulations, but they often interpret drag instructions as geometric displacements. This limits their effectiveness when the desired edit depends on interpreting image content and inferring a plausible semantic transformation from sparse point constraints. We introduce ThinkDrag, a unified multimodal framework for drag-based image editing with visual reasoning. ThinkDrag is trained to associate point constraints with meaningful object- and scene-level transformations, and can optionally produce an explicit reasoning trace that interprets the intended edit before image generation. This reasoning trace improves interpretability, particularly for ambiguous drags. Drag Endpoint Markers, motivated by an analysis of cross-image attention, provide an explicit correspondence signal that grounds each drag in image space. To support this framework, we construct a supervised dataset of semantic drag transformations paired with reasoning traces and introduce DragBench++, a benchmark targeting challenging drag-based editing scenarios with reference edit solutions. Experiments show that ThinkDrag achieves state-of-the-art performance, improving generation quality and plausibility while maintaining competitive point-following precision.
View arXiv page View PDF Project page GitHub 0 Add to collection
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.13316 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.13316 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.13316 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co