THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation
20 RLBench tasks × 14 perturbation factors (color, texture, lighting, distractors, camera pose, friction, mass…); reports 30–50% success drops for leading policies, 75%+ when perturbations combine.20 个 RLBench 任务 × 14 种扰动因素(颜色、纹理、光照、干扰物、相机位姿、摩擦、质量……);报告主流策略成功率下降 30–50%,多种扰动叠加时下降 75% 以上。
BibTeX
@misc{pumacay2024colosseum,
title = {{THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation}},
author = {Wilbert Pumacay and Ishika Singh and Jiafei Duan and Ranjay Krishna and Jesse Thomason and Dieter Fox},
year = {2024},
eprint = {2402.08191},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2402.08191},
}Datasets & Benchmarks数据集与基准Manipulation & Dexterous Hands操作与灵巧手simgeneralizationperturbationsrlbench