HAMSTER: Hierarchical Action Models for Open-World Robot Manipulation
A hierarchical VLA in which a fine-tuned VLM draws a coarse 2D path for the end effector on the image and a low-level 3D policy follows it, so the VLM can be trained on cheap off-domain data such as sim or videos.分层 VLA:微调后的 VLM 在图像上画出末端执行器的粗略二维路径,再由底层三维策略跟随执行;因此 VLM 可以用仿真、视频等低成本的非本域数据训练。
BibTeX
@misc{li2025hamster,
title = {{HAMSTER: Hierarchical Action Models for Open-World Robot Manipulation}},
author = {Yi Li and Yuquan Deng and Jesse Zhang and Joel Jang and Marius Memmel and Raymond Yu and Caelan Reed Garrett and Fabio Ramos and Dieter Fox and Anqi Li and Abhishek Gupta and Ankit Goyal},
year = {2025},
eprint = {2502.05485},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2502.05485},
}VLA & Robot Foundation ModelsVLA 与机器人基础模型Manipulation & Dexterous Hands操作与灵巧手realarmhierarchicalvlm-planner2d-paths