跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 28 天前AI 評分42

MatAnyone-E:以稀疏記憶傳播提升高解像度影片摳圖效率

MatAnyone-E: Sparse Memory Propagation for Efficient High-Resolution Video Matting

AI 導讀

MatAnyone-E 透過只對不確定區域進行高解像度匹配,並採用輕量解碼器,在維持與 MatAnyone 2 相若的摳圖品質下提升推理速度。在 4K 下,推理速度估計提升 7.4 倍,峯值 GPU 記憶體用量降至 MatAnyone 2 的 7.6%。使用單張 NVIDIA H200 GPU 並啟用編譯推理時,1080p 達 73.07 FPS,4K 達 28.62 FPS。

正文

Published on Oct 26

Authors:

,

,

,

,

Abstract

MatAnyone-E accelerates high-resolution video matting by selectively applying high-resolution matching to uncertain regions and using a lightweight decoder, achieving large speedups with preserved quality.

High-resolution video matting requires preserving fine details, such as hair strands and soft transparency, while maintaining consistency across frames. Memory-based methods achieve strong matting quality by matching current-frame features with information stored from earlier frames, but this process becomes increasingly costly as resolution grows. We present MatAnyone-E, an efficient extension of MatAnyone 2 that focuses computation where it is most needed. Our approach first performs low-resolution propagation to identify uncertain regions that require closer inspection and the memory candidates most relevant to them. It then performs high-resolution matching only for these regions using the selected memory, while reusing low-resolution matching results elsewhere. This strategy reduces both the number of locations requiring detailed matching and the amount of memory searched, while preserving the information needed to produce a complete matte. We further reduce the cost of generating high-resolution mattes with a lightweight decoder designed around measured runtime bottlenecks and trained to reproduce the original decoder's representations. Experiments show that MatAnyone-E maintains matting quality comparable to MatAnyone 2 while achieving an estimated 7.4x inference speedup and reducing peak GPU memory usage to 7.6% of the usage of MatAnyone 2 at 4K. With compilation-enabled inference on a single NVIDIA H200 GPU, it reaches 73.07 FPS at 1080p and 28.62 FPS at 4K.

View arXiv page View PDF Project page GitHub 54 Add to collection

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.35724 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.35724 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.35724 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co