MESA: An Evaluation Framework for Compositional, Semantic, and Spatial Generalization in Robotics
Suites isolate generalisation across spatial layout, object instance, object category and subtask composition, plus bimanual BiMESA. The best of seven baselines reaches only 52% and 49%.五组评测分别隔离空间布局、物体实例、物体类别和子任务组合上的泛化能力,并提供双臂版 BiMESA。七种基线中最好的也只有 52% 和 49%,仍有很大提升空间。
BibTeX
@misc{wilcox2026mesa,
title = {{MESA: An Evaluation Framework for Compositional, Semantic, and Spatial Generalization in Robotics}},
author = {Albert Wilcox and Frank Chang and Nhi Nguyen and Aishani Chakraborty and Jeremy A. Collins and Vaibhav Saxena and Benjamin Joffe and Siddharth Karamcheti and Animesh Garg},
year = {2026},
eprint = {2611.05567},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.05567},
}Datasets & Benchmarks数据集与基准Manipulation & Dexterous Hands操作与灵巧手Robot arm机械臂benchmarkgeneralizationbimanualsimvla