CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents
Turns a small open VLM into a code-as-policy agent: SFT, then multi-turn RL with a physical critic. Reports Qwen3.5-4B going from 0% to 73.8% on held-out LIBERO; code, data and weights released.把小型开放 VLM 训练成“代码即策略”机器人智能体的开源流水线：先 SFT，再做多轮 RL，并用读取仿真特权状态的物理评论家为每次请求分配贡献。报告 Qwen3.5-4B 在留出的 LIBERO 上由 0% 升到 73.8%，并公开代码、数据和权重。
BibTeX
@misc{fan2026captain,
title = {{CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents}},
author = {Yijia Fan and Xilin He and Yilei Jiang and Dongming Wu and Jiaxu Wang and Xiangyu Yue},
year = {2026},
eprint = {2610.40799},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.40799},
}VLA & Robot Foundation ModelsVLA 与机器人基础模型Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习code-as-policypost-trainingrlliberoreal