LongZero:以零外部數據提升大語言模型長上下文推理
LongZero: Enhancing Long-Context Reasoning in LLMs from Zero Data
LongZero 透過合成結構化多跳推理及檢索任務,並以 GRPO 訓練,讓大語言模型無需外部數據即可提升長上下文推理能力。研究在兩個大語言模型及五個長上下文推理基準上評估,結果顯示 LongZero 可泛化至真實任務,並勝過兩種基線方法。
Published on Oct 21
Authors:
Abstract
LongZero enables large language models to self-improve long-context reasoning by synthesizing structured multi-hop and retrieval tasks and training with GRPO without external data.
Reinforcement learning (RL) is an effective way to strengthen the long-context reasoning of large language models (LLMs), but it needs training data that are long, diverse, challenging, and verifiable. Human annotation of such data is expensive, naturally occurring data are too scarce to sustain RL, and existing synthesis methods depend on external corpora or stronger teacher models, which become harder to obtain as the trained models get stronger. Recently, RL from zero data, in which a model learns from tasks it proposes itself, has achieved excellent performance, but existing methods target short-context tasks. Therefore, we propose LongZero, a method that lets an LLM improve its own long-context reasoning without any external data. Instead of writing questions and answers over existing documents, LongZero first has the model synthesize the question and answer with its supporting evidence in a compact structured form, and only then separately expands the evidence into a long multi-document context. LongZero combines these self-written multi-hop reasoning tasks with self-written multi-round retrieval tasks and trains the model with GRPO. We evaluate LongZero on two LLMs across five long-context reasoning benchmarks and compare it with RL on data synthesized from external corpora. Experimental results show that LongZero can generalize to real tasks, and outperforms both baselines, suggesting a viable and promising path to improving long-context reasoning of LLMs.
View arXiv page View PDF GitHub 4 Add to collection
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.30132 in a model README.md to link it from this page.
Datasets citing this paper 1
zhennan1/LongZero
Viewer • Updated about 1 hour ago • 7.68k • 73
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.30132 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co