跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 27 天前AI 評分52

MLE-World 用學習式世界模型預測機器學習實驗結果

MLE-World: Predicting Machine Learning Experiment Outcomes with a Learned World Model

AI 導讀

MLE-World 提出一種學習式世界模型,讓 AI 研究智能體無須實際執行程式即可預測機器學習實驗結果。它由 Qwen3.5-4B 微調而成,根據程式碼和數據描述預測程式的終端輸出;在 17 項 MLE-bench Lite 任務的留出程式中,與真實終端輸出的吻合率為 77.9%,而規模大得多的提示模型為 41.1%。

正文

Published on Oct 27

Authors:

,

,

,

Abstract

A world model predicts machine learning program outcomes to enable affordable test-time scaling for AI research agents, improving performance with fewer real executions.

AI research agents can propose, execute, and improve programs that solve machine learning tasks. However, executing each candidate program requires training and evaluating ML models, limiting how many candidates an agent can explore at each step. We introduce MLE-World, a world model finetuned from Qwen3.5-4B that predicts a program's terminal output (error traces, training logs, and validation scores) from its code and data description without executing it, together with a confidence score estimating the prediction's correctness. Because a prediction costs one inference call rather than a training run, MLE-World makes test time scaling (TTS) affordable for these agents. We build five TTS policies, guided by MLE-World, that compare several candidates per step by their predicted outputs: Sequential revision, Best-of-N, Pairwise judging, Fusion, and a UCB style rule that also adds an exploration bonus from this confidence score. Since predictions can be wrong, we run a candidate for real only when its confidence score is low. On 17 MLE-bench Lite tasks, MLE-World matches the real terminal output on 77.9% of held out programs, versus 41.1% for much larger prompted models. MLE-World guided TTS achieves up to 22.1% higher observed mean performance than the agent without a world model, with less real execution. Project webpage: https://mle-world.github.io/.

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2610.37175

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.37175 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.37175 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.37175 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co