跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-19AI 評分40

Scaling Parameter-Efficient Fine-Tuning for Brain Encoding

Scaling Parameter-Efficient Fine-Tuning for Brain Encoding

AI 導讀

研究提出以低秩適配器進行參數高效微調,將多模態骨幹模型用於腦編碼,並把適配規模擴展至最多 104B 參數。方法在九個多模態骨幹上提升腦編碼表現,並在 Qwen3-Omni 上取得 Algonauts 2025 Challenge 最佳已發表成績。多 LoRA kernel 支援 200+ 個適配模型組成的集成,於撰文時在 Algonauts 賽後公開排行榜排名第一。

正文

Published on Oct 19

Authors:

,

,

,

,

,

,

,

Abstract

Parameter-efficient fine-tuning with low-rank adapters enables efficient adaptation of very large multimodal backbones for brain encoding, improving performance and interpretability while reducing computational cost.

Brain encoding models aim to predict neural responses to stimuli. The most widely used approach fits readouts from frozen pretrained backbones. Using neural data to train large models from scratch or fully fine-tune them after task-pretraining has proven difficult because neural data is costly and limited. We show that parameter-efficient fine-tuning (PEFT) enables us to effectively adapt very large pretrained backbones for brain encoding with a small number of trainable parameters. To make it computationally practical, we exploit the backbone's causal structure to predict multiple timepoints in a single pass instead of using sliding windows, significantly reducing feature-extraction cost. This enables efficient fine-tuning of multimodal backbones with up to 104B parameters, the largest model adapted for brain encoding to our knowledge. Trained with a low-rank adapter (LoRA) and a lightweight readout, our approach consistently improves brain encoding performance across nine diverse multimodal backbones. On the same Qwen3-Omni backbone as the prior state-of-the-art (SoTA), our method BrainLoRA achieves the best published performance on the Algonauts 2025 Challenge. We also show the adapted multimodal backbones remain interpretable: modality attribution recovers the canonical sensory topography that prior work often obtains by construction from separate unimodal encoders, and neural adaptation increases the contribution of audio inputs and cross-modal mixing within the backbone. To scale out the number of adapted models, we develop a multi-LoRA kernel that accelerates joint training of multiple LoRAs on a shared backbone. This enables an ensemble of 200+ adapted models that ranks first on the public Algonauts post-challenge leaderboard at the time of writing. Together, our results highlight PEFT as an efficient and powerful paradigm for brain encoding.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.26802

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

zfying/brain-lora

Updated about 1 hour ago

•

1

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.26802 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.26802 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co