Semantics-to-Contact: A Stagewise Framework for Robust Contact-Rich Manipulation
A VLM first localizes the task region, then real-world human-in-the-loop residual RL with force feedback learns the contact part. Object-centric background augmentation adds robustness; six real tasks.分两阶段:先由视觉语言模型定位任务相关区域,再在真实世界用带力反馈、人在回路的残差强化学习学习接触细节。以物体为中心的背景增强使其在六个真机任务上保持稳健。
BibTeX
@misc{qiao2026semantics,
title = {{Semantics-to-Contact: A Stagewise Framework for Robust Contact-Rich Manipulation}},
author = {Guanren Qiao and Ruixiang Ouyang and Sheng Xu and Yueci Deng and Yunxin Tai and Kui Jia and Guiliang Liu},
year = {2026},
eprint = {2611.07532},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.07532},
}