跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-07AI 評分49

Iris-3B: Going Beyond the Latent with Pixel-Space Diffusion Training, Conversion and Fine-Tuning

Iris-3B: Going Beyond the Latent with Pixel-Space Diffusion Training, Conversion and Fine-Tuning

AI 導讀

Iris-3B 研究像素空間擴散模型的預訓練、轉換與微調,並發現像素空間生成先驗未能顯著改善下游任務表現。在深度估計及 4 倍 DIV2K 圖像修復中,像素空間模型均未勝過微調後的潛在空間 FLUX.2 Klein;不過,Iris-3B 達到 3B 參數規模,並在 OneIG 的 1024^2 評測中取得與 Qwen-Image 相若的文生圖品質。作者已公開模型權重及訓練程式碼。

正文

Published on Oct 7

Authors:

Abstract

Pixel-space diffusion models avoid the lossy VAE of latent models, which suggests an advantage on downstream tasks where fine-grained detail matters. We test this claim along both routes to a pixel-space backbone. We pretrain Iris-3B, a 3B-parameter pixel-space text-to-image transformer, from scratch through a 256to512to1024 curriculum, after first ablating the prediction target and representation alignment at 256^2 to decide what to scale. We also convert a pretrained latent model, FLUX.2 Klein base 4B, to pixel space. We fine-tune both families for monocular depth estimation and for image restoration/super-resolution. We find no significant improvement from using a pixel-space generative prior. Fine-tuned for depth with one matched direct-regression recipe, Iris-3B is level with the latent FLUX.2 Klein and the converted pixel FLUX.2 Klein falls behind it, and on 4times DIV2K restoration neither pixel model beats a latent FLUX.2 Klein fine-tune, the converted one trailing it slightly. We document the recipes, the failure modes and the remaining confounds behind this negative result. Nevertheless, Iris-3B shows that pixel-space pretraining with the pixel-transformer (PiT) head of PixelDiT scales to 3B parameters and to text-to-image quality competitive with latent models, matching Qwen-Image on OneIG under the official evaluators at 1024^2. We release its weights and training code in the hope that they help pave the way for further work on pixel-space generation.

View arXiv page View PDF Project page GitHub 3 Add to collection

Get this paper in your agent:

hf papers read 2610.09450

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

speridlabs/iris-3b

Text-to-Image •

3B •

Updated about 2 hours ago

•

18

•

2

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.09450 in a dataset README.md to link it from this page.

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co