DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imagination
Dexterous visuotactile VLA on a mixture-of-transformers: contact-aware gating decides when touch matters; the model jointly imagines future visual and tactile latents. Reports 71% average success on contact-rich tasks.基于混合 Transformer 的灵巧视触觉 VLA:接触感知门控决定何时引入触觉,并联合想象未来的视觉与触觉潜变量。报告在富接触任务上平均成功率 71%。
BibTeX
@misc{fu2026decal,
title = {{DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imagination}},
author = {Yankai Fu and Ning Chen and Junkai Zhao and Heng Zhang and Guocai Yao and Pengwei Wang and Zhongyuan Wang and Shanghang Zhang},
year = {2026},
eprint = {2609.09119},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2609.09119},
}Manipulation & Dexterous Hands操作与灵巧手VLA & Robot Foundation ModelsVLA 与机器人基础模型Tactile & Visuotactile Sensing触觉与视触觉感知Dexterous hand灵巧手dexterousvisuotactilemixture-of-transformerslatent-imaginationreal