RoboColosseum: Evaluating Physical Intelligence at Scale In-The-Wild
Blinded pairwise trials at 124 sites compare VLAs and frontier agents. Rankings barely agree across robots (W = 0.24), and open rankings poorly predict results after fine-tuning; no policy finishes a G1 task.在 124 个站点做盲测两两对比，横跨四种机器人评测 VLA 与前沿智能体。不同机器人的排名几乎不一致（Kendall W = 0.24），开箱排名也难以预测微调后的表现；G1 人形上没有策略完成任何任务。
BibTeX
@misc{nguyen2026robocolosseum,
title = {{RoboColosseum: Evaluating Physical Intelligence at Scale In-The-Wild}},
author = {Tan Sang Nguyen and Yi Ru Wang and Shailesh Shailesh and Gang Yang and Jiamo Hu and Jianuo Jiang and Haoquan Fang and Zhongzheng Ren and Zhongyi Luo and Ian Chong and Aaron Tung and Santiago Pravisani and Minghui Lin and Yao Mo and Ishneet Singh and Benjamin Tee and Harold Soh and Siddhartha Srinivasa and Dieter Fox and David Hsu and Haoming Song and Maxime Ellerbach and Thomas Wolf and Pepijn Kooijmans and Ruijie He and Michael Cho and Jiafei Duan},
year = {2026},
eprint = {2611.02497},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.02497},
}