GenManip: LLM-driven Simulation for Generalizable Instruction-Following Manipulation
Isaac Sim platform where an LLM builds tasks and layouts from a task-oriented scene graph over ~10K objects; its 200-scenario benchmark finds modular foundation-model systems generalize better than end-to-end policies.基于 Isaac Sim 的平台:LLM 依据任务导向场景图,从约 1 万个物体中生成任务与布局;其 200 个场景的基准发现,结合基础模型的模块化系统比端到端策略泛化更好。
BibTeX
@misc{gao2025genmanip,
title = {{GenManip: LLM-driven Simulation for Generalizable Instruction-Following Manipulation}},
author = {Ning Gao and Yilun Chen and Shuai Yang and Xinyi Chen and Yang Tian and Hao Li and Haifeng Huang and Hanqing Wang and Tai Wang and Jiangmiao Pang},
year = {2025},
eprint = {2506.10966},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2506.10966},
}Sim-to-Real & Simulators仿真与 Sim-to-RealManipulation & Dexterous Hands操作与灵巧手Datasets & Benchmarks数据集与基准simisaac-simbenchmarkllmgeneralization