S2A2: Audio-Visual Imitation Learning for Manipulation Tasks Using Acoustic Spatial Information
New manipulation tasks where the target must be found by sound, plus an imitation framework that adds acoustic spatial and spectral features to ACT, Diffusion Policy, VQ-BeT and π0. Sim + real.提出需要靠声音确定操作目标的新任务,以及把声源空间信息与频谱特征接入 ACT、Diffusion Policy、VQ-BeT 和 π0 的多模态模仿学习框架。仿真与真机验证。
BibTeX
@misc{hiratsuka2026s,
title = {{S2A2: Audio-Visual Imitation Learning for Manipulation Tasks Using Acoustic Spatial Information}},
author = {Kaneyoshi Hiratsuka and Benjamin Yen and Ryosuke Kojima},
year = {2026},
eprint = {2607.26047},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2607.26047},
}