CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
Instead of emitting action tokens from the VLM, a separate diffusion action transformer is conditioned on the VLM's "cognition" feature; reports clear gains over OpenVLA in sim and on real robots.不再让 VLM 直接输出动作 token，而是用独立的扩散动作 Transformer 以 VLM 的“认知”特征为条件生成动作；报告在仿真和真机上明显优于 OpenVLA。
BibTeX
@misc{li2024cogact,
title = {{CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation}},
author = {Qixiu Li and Yaobo Liang and Zeyu Wang and Lin Luo and Xi Chen and Mozheng Liao and Fangyun Wei and Yu Deng and Sicheng Xu and Yizhong Zhang and Xiaofan Wang and Bei Liu and Jianlong Fu and Jianmin Bao and Dong Chen and Yuanchun Shi and Jiaolong Yang and Baining Guo},
year = {2024},
eprint = {2411.19650},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2411.19650},
}