Profiling a Frontier Agent with EBench: From Direct Control to Harness with Policy
Report: GPT-6-Astra drives a robot on EBench via waypoints or by calling a VLA/WAM policy. Direct control leads on short tasks, trails on long-horizon and contact-rich ones; calling a policy cuts token cost.评测报告：在 EBench 上让 GPT-6-Astra 直接输出路径点控制机器人，或通过执行框架调用 VLA/WAM 策略。直接控制在短时任务上领先，但在长时程与接触密集任务上落后；调用策略可显著减少 token 开销。
BibTeX
@misc{yao2026profiling,
title = {{Profiling a Frontier Agent with EBench: From Direct Control to Harness with Policy}},
author = {Yifei Yao and Yude Zou and Guanbo Jiao and Xing Gao and Ning Gao and Yukai Wang and Jiantong Chen and Zihou Zhu and Xinyu Li and Ningyu Yan and Shuai Wang and Jianming Ma and Haoyu Guo and Weinan Zhang and Chunhua Shen},
year = {2026},
eprint = {2610.35832},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.35832},
}VLA & Robot Foundation ModelsVLA 与机器人基础模型Manipulation & Dexterous Hands操作与灵巧手benchmarkllmharnessevaluationfrontier-modelsim