Ropedia W0 以人類經驗擴展跨具身形態移動操作世界模型
Ropedia W0: Scaling Loco-Manipulation World Models across Embodiments with Human Experience
論文提出 Ropedia W0,一個透過統一運動學表示整合人類與機械人數據、支援跨具身形態移動操作的世界基礎模型。其 Xp-Data 包含 10k hours 的人類第一人稱視角數據及 3k hours 的機械人數據,並推出以高質素靈巧人形機械人遙操作數據為基礎的長時程基準 Xp-Teleop。
Published on Oct 19
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
Ropedia W0 is a world foundation model for cross-embodiment loco-manipulation that unifies human and robot data via kinematic representations and achieves state-of-the-art results across diverse benchmarks.
World models enable embodied agents to anticipate action consequences, yet jointly modeling locomotion and manipulation across diverse embodiments remains challenging due to heterogeneous action spaces and limited multimodal supervision. We present Ropedia W0, the first egocentric loco-manipulation world foundation model spanning humans and robots with diverse embodiments. We curate Xp-Data, comprising 10k hours of egocentric human data and 3k hours of robot data with unified multimodal annotations and systematic quality control. A unified kinematic representation encodes locomotion through camera poses and manipulation through projected skeletons, with robot skeletons combining embodiment-specific forward kinematics with extensive manual keypoint annotation and correction. We also introduce Xp-Teleop, a long-horizon loco-manipulation benchmark based on high-quality dexterous humanoid teleoperation data. Evaluations demonstrate state-of-the-art performance across five cross-embodiment benchmarks (DreamDojo, Ψ_0, ω-HOME, Xp-Teleop, and AgiBot) and on held-out human egocentric video, from zero-shot inference to few-shot and full-data post-training. Scaling human pre-training data improves performance on both human and robot evaluations. After distillation, our model supports real-time, minute-long rollouts, enabling live VR interaction. Applications in policy evaluation, model-based planning, and world-action modeling further demonstrate the model's utility for embodied decision-making.
View arXiv page View PDF Project page GitHub 24 Add to collection
Get this paper in your agent:
hf papers read 2610.26855
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 1
Image-to-Video • Updated 1 day ago • 14ropedia-ai/Ropedia-W0
Datasets citing this paper 1
ropedia-ai/Xp-Teleop
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.26855 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co