How to Learn from What a Human Would Avoid? Intervention-Aware World Models with Real-World RL for Dexterous Manipulation
Human-in-the-loop RL whose latent world model also predicts when the operator would take over, steering the policy away from risky states. On a 16-DoF LEAP Hand: 96.7% grasp success, up to 84% less intervention.人在回路强化学习:潜在世界模型额外预测操作者何时会接管,并据此让策略远离高风险状态。在 16 自由度 LEAP 手上抓取成功率 96.7%,人工干预最多减少 84%。
BibTeX
@misc{yin2026how,
title = {{How to Learn from What a Human Would Avoid? Intervention-Aware World Models with Real-World RL for Dexterous Manipulation}},
author = {Jiaju Yin and Zhenhui Zhang and Lixin Xu and Heng Zhang and Jun Shao and Yating Feng and Arash Ajoudani and Renjing Xu},
year = {2026},
eprint = {2609.06009},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2609.06009},
}Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习Dexterous hand灵巧手real-world-rlhuman-in-the-loopworld-modeldexterousleap-hand