跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 27 天前AI 評分34

PDRVLA:具備物理動力學表徵的視覺-語言-動作模型

PDRVLA: A Vision-Language-Action Model with Physical Dynamics Representations

AI 導讀

PDRVLA透過輕量級物理動力學模組,利用世界模型監督預測未來視覺特徵,改善機械人動作生成,並避免在線生成影片造成的延遲。在四項模擬基準測試中,PDRVLA於LIBERO、LIBERO-Plus、RoboTwin 2.0及SimplerEnv的成功率分別為99.3%、89.9%、93.6%及81.5%。訓練完全使用公開數據,並透過人類到機械人的合成、子任務標註及具身鏈式推理標註擴充。

正文

Published on Oct 27

·

Submitted by

lma

on Oct 28

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

PDRVLA improves robot action generation by integrating a lightweight physical dynamics module that predicts future visual features with world-model supervision, avoiding online video generation latency.

Vision--Language--Action (VLA) models generate robot actions from visual observations and language instructions, but their understanding of physical dynamics remains limited. Video world models can capture scene dynamics, yet generating future videos introduces high latency into the control loop. We introduce PDRVLA, whose lightweight Physical Dynamics Module extracts physical tokens from vision--language features to condition action generation without online video generation. The module learns through direct prediction of future RGB, depth, and optical-flow features, with auxiliary supervision through a frozen pretrained video world model. Training relies entirely on publicly available data, expanded through human-to-robot synthesis, subtask annotation, and embodied chain-of-thought (ECoT) annotation. Across four simulation benchmarks, PDRVLA achieves success rates of 99.3% on LIBERO, 89.9% on LIBERO-Plus, 93.6% on RoboTwin~2.0, and 81.5% on SimplerEnv. Ablations show improved future prediction with world-model supervision and evaluate how subtask conditioning, future object-pose supervision, and ECoT training affect action success.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.37381

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.37381 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.37381 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.37381 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co