ACTS: Learning Visuo-Tactile World Models from Human Physical Interaction
Visuo-tactile world model trained only on humans handling GelSight sensors (4.9 h React dataset). Reports that contact dynamics transfer to robot rollouts more reliably than visual appearance does.只用人手持 GelSight 传感器的交互数据（4.9 小时 React 数据集）训练视触觉世界模型。报告在机器人回放中接触动态比视觉外观更容易迁移，部分任务的相机视角预测甚至不如直接复制帧。
BibTeX
@misc{ma2026acts,
title = {{ACTS: Learning Visuo-Tactile World Models from Human Physical Interaction}},
author = {Yuxiang Ma and Weihan Xu and Pengfei Ye and Anna Mei and Yuxin Ray Song and Tingle Li and Haonan Chen and Edward H. Adelson},
year = {2026},
eprint = {2610.24285},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.24285},
}Tactile & Visuotactile Sensing触觉与视触觉感知World Models世界模型Robot arm机械臂gelsighthuman-dataworld-modelbimanualdataset