IMBench: A Benchmark for Intuitive Robotic Manipulation
IMBench: 35 tasks and 14K trajectories testing reasoning and execution together under explicit constraints. VLMs reason partly but fail to plan executable steps; VLAs struggle with the constraints.IMBench:35 个任务、1.4 万条轨迹,在显式约束下同时考察物理推理与动作执行。VLM 有部分推理能力但给不出可执行计划,VLA 难以满足任务约束。
BibTeX
@misc{maurya2026imbench,
title = {{IMBench: A Benchmark for Intuitive Robotic Manipulation}},
author = {Anurag Maurya and Sukhvansh Jain and Prajwal Avhad and Gautham Balachandran and Ziyi Zhou and Atharva Kshirsagar and Satyam Singh and Bowen Li. Rishabh Mukund and Ritul Singh and Jatin Vira and Suvonil Chatterjee and Devesh K. Jha},
year = {2026},
eprint = {2607.15641},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2607.15641},
}