SoftPaint:以軟遮罩調節圖像與影片的像素級編輯強度
Diffusion Editing with Soft Mask: Pixel Level Redo of Image and Video with Adjustable Strength
SoftPaint 是一種零樣本擴散取樣方法,利用軟遮罩按像素調節編輯強度,令內容可由完整保留至遮罩區域完全重新生成。方法採用基於 Langevin 迭代的取樣器,遵循每個像素的軟遮罩強度,適用於圖像及影片擴散模型。它毋須梯度、節省記憶體,並可在多種圖像及影片骨幹模型上實現平滑的像素級編輯。
Published on Sep 30
·
on Oct 14
Authors:
Abstract
Diffusion models with prompt and reference image-guided editing have seen rapid progress, yet they remain too coarse for pixel-level control. One promising direction is to incorporate a soft mask that specifies spatially varying edit strengths but training such fine-grained control demands expensive pixel-wise annotations, while existing zero-shot methods often yield unsatisfactory results. We introduce SoftPaint, a new zero-shot sampling method that leverages soft masks to enable a continuous spectrum of edits, from fully preserving the original content to completely re-synthesizing the masked region. Going beyond zero-shot inpainting methods, we design a Langevin-iteration-based sampler that respects per-pixel soft mask strengths, which applies universally to image and video diffusion models, enabling tasks such as video editing. The method is gradient-free, memory-efficient, and achieves smooth, pixel-level edits across multiple image and video backbones.
View arXiv page View PDF Add to collection
Get this paper in your agent:
hf papers read 2610.00359
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.00359 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.00359 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.00359 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co