Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Models
Adds separate tactile, force and torque streams to a pretrained VLA through joint cross-modal attention, with staged training and an auxiliary task that predicts future physical signals. Real-robot tests.为预训练 VLA 增加独立的触觉、力和力矩信号流,通过跨模态联合注意力融合,配合分阶段训练和预测未来物理信号的辅助任务。真机实验验证。
BibTeX
@misc{lee2026modular,
title = {{Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Models}},
author = {Jimin Lee and Huiwon Jang and Myungkyu Koo and Jungwoo Park and Jinwoo Shin},
year = {2026},
eprint = {2604.23272},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2604.23272},
}