Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matching
Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matching
FreeMatching 是一個通用框架,結合生成式與語義基礎表徵,以及來自傳統數據集、追蹤影片和合成場景的異質監督,旨在應對影像編輯與參考引導生成中的密集對應匹配。實驗顯示,單一 FreeMatching 模型提升了具挑戰性的影像對之對應品質,同時在傳統基準測試中保持競爭力。它亦可作為量化身份保留程度的指標,評分與人類判斷相關。
Published on Oct 8
Authors:
,
,
Abstract
Dense correspondence matching has historically been bounded by simplifying spatio-temporal priors, such as smooth motion and rigid geometry. While effective for classical tasks, these assumptions break down in image editing and reference-guided generation (IEG), where transformations can preserve visual identity while breaking physical continuity. To establish identity-preserving correspondence across such transformations, we introduce FreeMatching, a generalizable framework combining generative and semantic foundation representations with heterogeneous supervision from classical datasets, tracked videos, and synthetic scenes. Teacher-guided iterative refinement further improves correspondence in IEG without dense correspondence annotations. Experimentally, a single FreeMatching model substantially improves correspondence quality on challenging IEG image pairs while retaining competitive performance on classical benchmarks. Furthermore, we demonstrate its utility as a quantitative metric for evaluating identity preservation, with scores that correlate with human judgment. The code is available at https://github.com/luping-liu/FreeMatching.
View arXiv page View PDF GitHub Add to collection
Get this paper in your agent:
hf papers read 2610.12421
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.12421 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.12421 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.12421 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co