From VLM Planners to Robotic Agents: Self-Evolving Harnesses for History-Dependent Manipulation
SERA turns the high-level VLM into an agent with an editable harness that tracks task progress for a fixed VLA executor, and revises the harness from rollouts; reports 51.4% vs 44.4% overall success on RoboMME.SERA 把高层 VLM 规划器做成带可编辑执行框架的智能体,为固定的底层 VLA 记录任务进度与执行反馈,并利用环境回放自动改进框架;报告在 RoboMME 上总体成功率 51.4%,未自我演化时为 44.4%。
BibTeX
@misc{du2026from,
title = {{From VLM Planners to Robotic Agents: Self-Evolving Harnesses for History-Dependent Manipulation}},
author = {Tingwen Du and Haoyu Guo and Hanxue Zhang and Xuanxu Wang and Junting Dong and Chao Gao and Mingfei Han and Tao Lu and Mulin Yu and Chunhua Shen and Xiaojun Chang and Zhihui Li},
year = {2026},
eprint = {2610.29560},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.29560},
}Manipulation & Dexterous Hands操作与灵巧手VLA & Robot Foundation ModelsVLA 与机器人基础模型agenticharnessmemorylong-horizonvlm-plannersim