跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-15AI 評分41

EvoHeir:選擇並非學習——如何決定模型的演進方向

Selection Is Not Learning: Choosing Model Futures

AI 導讀

EvoHeir將參數繼承與經驗繼承分開,並以全新評估題目判斷是否繼承模型更新,改善自我演進語言模型的繼承方式。HeirCommit在相同接納率下,較隨機繼承將已接納更新中的有害比例降低68-83%。EvoHeir在四個骨幹模型上的數學及一般推理平均表現最佳,數學平均較最強基線Agent0高5.3%。

正文

Published on Oct 15

Authors:

,

,

Abstract

EvoHeir improves self-evolving language model loops by separating parameter and experience inheritance and using fresh evaluation to confirm updates, reducing harmful inheritance and boosting reasoning performance.

Self-evolving language models train on tasks they generate, so every round must decide which updated model the next round inherits. Current loops such as R-Zero, Agent0, and Skill Self-Play make this decision through the task, admitting tasks that look learnable and inheriting every resulting update. We identify a selection-to-update gap in these loops, where a task that looks learnable need not produce a useful update. Most updates on verified tasks fail to make correct answers more likely, yet these loops inherit them all. HeirCommit freezes the updated model and uses fresh evaluation questions to decide whether to inherit it or retain the current model. EvoHeir separates parameter inheritance from experience inheritance, using current and archived experience to repair failures and preserve successes before final confirmation. Our analysis characterizes selection-induced optimism and decomposes regret into selection, absorption, and confirmation errors. HeirCommit cuts the harmful share of accepted updates by 68-83% relative to random inheritance at the same acceptance rate. Across four backbones, EvoHeir achieves the best mathematics and general-reasoning averages, raising the math average by 5.3% relative to the strongest baseline, Agent0. The framework lets useful experience persist even when the model that produced it is not inherited.

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2610.22029

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.22029 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.22029 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.22029 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co