OmniPiano: Diverse Dexterous Piano-Playing Challenges for Standard, Robust, Safe, and Multi-Agent RL
Extends robot piano to one to five Shadow Hands, with robust, safe and multi-agent RL settings: at least 912 task settings and 36 baselines. Reports that top RL algorithms and LLM agents still struggle.把机器人弹钢琴扩展到 1 至 5 只 Shadow 手,并支持鲁棒、安全和多智能体强化学习:至少 912 种任务设置、36 个基线算法。作者报告前沿算法与大模型智能体在高难任务上仍很吃力。
BibTeX
@misc{xu2026omnipiano,
title = {{OmniPiano: Diverse Dexterous Piano-Playing Challenges for Standard, Robust, Safe, and Multi-Agent RL}},
author = {Fan Xu and Fan Yang and Yifan Xu and Ruiyuan Zhang and Yimou Wu and Nuo Yi and Muning Wen and Guang Chen and Costas Spanos and Shangding Gu},
year = {2026},
eprint = {2611.00243},
archivePrefix = {arXiv},
primaryClass = {cs.AI},
url = {https://arxiv.org/abs/2611.00243},
}Datasets & Benchmarks数据集与基准Manipulation & Dexterous Hands操作与灵巧手Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习Dexterous hand灵巧手benchmarkdexterousmulti-agentsafe-rlsim