RoboScope Kit: Unified Interfaces for Fast and Scalable Embodied-AI Evaluation
Wraps each model once and each benchmark once, then schedules simulator workers and policy replicas as separate pools; reports evaluation 4.45x to 6.16x faster than the official StarVLA evaluator on one GPU.模型和基准各封装一次,把仿真 worker 与策略副本分成两个池调度;报告单卡评测比官方 StarVLA 评测器快 4.45 到 6.16 倍。
BibTeX
@misc{wu2026roboscope,
title = {{RoboScope Kit: Unified Interfaces for Fast and Scalable Embodied-AI Evaluation}},
author = {Deng-Ke Wu and Yifan Jin and Yida Yang and Lei Qian and Zhaoye Zhou and Hongru Zhang and Kai Ye and Shuyuan Hu and Yiran Mao and Zewei Ye and Bo Zhao},
year = {2026},
eprint = {2611.03850},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.03850},
}