VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Tasks
100 task categories over 2,000+ objects that need common sense, world knowledge and multi-step reasoning, not just instruction following; evaluates VLAs, embodied agents and VLMs in one suite.100 类任务、2000 多个物体，任务需要常识、世界知识与多步推理，而不只是照指令执行；在同一套件中评测 VLA、具身智能体与 VLM。
BibTeX
@misc{zhang2024vlabench,
title = {{VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Tasks}},
author = {Shiduo Zhang and Zhe Xu and Peiju Liu and Xiaopeng Yu and Yuan Li and Qinghui Gao and Zhaoye Fei and Zhangyue Yin and Zuxuan Wu and Yu-Gang Jiang and Xipeng Qiu},
year = {2024},
eprint = {2412.18194},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2412.18194},
}Datasets & Benchmarks数据集与基准VLA & Robot Foundation ModelsVLA 与机器人基础模型Manipulation & Dexterous Hands操作与灵巧手simlanguagelong-horizonreasoningvla-eval