PDRVLA:具備物理動力學表徵的視覺-語言-動作模型
PDRVLA: A Vision-Language-Action Model with Physical Dynamics Representations
PDRVLA透過輕量級物理動力學模組,利用世界模型監督預測未來視覺特徵,改善機械人動作生成,並避免在線生成影片造成的延遲。在四項模擬基準測試中,PDRVLA於LIBERO、LIBERO-Plus、RoboTwin 2.0及SimplerEnv的成功率分別為99.3%、89.9%、93.6%及81.5%。訓練完全使用公開數據,並透過人類到機械人的合成、子任務標註及具身鏈式推理標註擴充。
Published on Oct 27
·
on Oct 28
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
PDRVLA improves robot action generation by integrating a lightweight physical dynamics module that predicts future visual features with world-model supervision, avoiding online video generation latency.
Vision--Language--Action (VLA) models generate robot actions from visual observations and language instructions, but their understanding of physical dynamics remains limited. Video world models can capture scene dynamics, yet generating future videos introduces high latency into the control loop. We introduce PDRVLA, whose lightweight Physical Dynamics Module extracts physical tokens from vision--language features to condition action generation without online video generation. The module learns through direct prediction of future RGB, depth, and optical-flow features, with auxiliary supervision through a frozen pretrained video world model. Training relies entirely on publicly available data, expanded through human-to-robot synthesis, subtask annotation, and embodied chain-of-thought (ECoT) annotation. Across four simulation benchmarks, PDRVLA achieves success rates of 99.3% on LIBERO, 89.9% on LIBERO-Plus, 93.6% on RoboTwin~2.0, and 81.5% on SimplerEnv. Ablations show improved future prediction with world-model supervision and evaluate how subtask conditioning, future object-pose supervision, and ECoT training affect action success.
View arXiv page View PDF Add to collection
Get this paper in your agent:
hf papers read 2610.37381
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.37381 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.37381 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.37381 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co