What Actually Matters? A Paired Evaluation of Inference Settings for π0.5 on BEHAVIOR-1K
Paired test of previously proposed inference and data-collection tricks on all 100 BEHAVIOR-1K tasks with a π0.5 based on the 2025 challenge winner (Q-score 0.39): the tricks do not transfer uniformly.在 BEHAVIOR-1K 全部 100 个任务上，以基于 2025 BEHAVIOR 挑战赛冠军方案微调的 π0.5（公开测试集 Q 分 0.39）为对象，对已有推理与数据采集技巧做配对评测；结论是这些技巧在新环境与任务上的效果并不一致，提醒小规模结论不宜直接外推。
BibTeX
@misc{hammele2026what,
title = {{What Actually Matters? A Paired Evaluation of Inference Settings for π0.5 on BEHAVIOR-1K}},
author = {Ruben Hammele and Samira Huber and Mohammad Nazeri and Amirreza Payandeh and Alexandyr T. Card and Aaron Nguyen and Anuj Pokhrel and Daeun Song and Xuesu Xiao and Sören Pirk},
year = {2026},
eprint = {2610.37917},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.37917},
}VLA & Robot Foundation ModelsVLA 与机器人基础模型Datasets & Benchmarks数据集与基准evaluationpi0.5behavior-1kinference-strategieshouseholdsim