Multisensory Continual Learning: Adapting Pretrained Visuomotor Policies to Force
Adds force-torque sensing to a pretrained vision-only world-action model with staged fusion, multisensory future prediction and replay of pretraining data; strong on contact tasks without losing original skills.通过分阶段融合、多感官未来预测和预训练数据回放,把力/力矩传感加入预训练的纯视觉世界动作模型;在富接触任务上表现好,同时保住甚至提升原有任务性能。
BibTeX
@misc{clark2026multisensory,
title = {{Multisensory Continual Learning: Adapting Pretrained Visuomotor Policies to Force}},
author = {Jaden Clark and Changhao Wang and Yihuai Gao and Seongheon Hong and Hojung Choi and Mark Cutkosky and Yifan Hou and Shuran Song},
year = {2026},
eprint = {2606.30988},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2606.30988},
}Tactile & Visuotactile Sensing触觉与视触觉感知continual-learningforce-torqueworld-action-modelfine-tuningreal