CLIPort: What and Where Pathways for Robotic Manipulation
CLIPort — combines CLIP's semantic "what" stream with Transporter's spatial "where" stream for language-conditioned tabletop manipulation; an early bridge from web vision-language models to robot actions.CLIPort:把 CLIP 提供的语义"是什么"通路与 Transporter 的空间"在哪里"通路结合,实现语言条件的桌面操作;是较早把网络视觉语言模型接入机器人动作的工作。
BibTeX
@misc{shridhar2021cliport,
title = {{CLIPort: What and Where Pathways for Robotic Manipulation}},
author = {Mohit Shridhar and Lucas Manuelli and Dieter Fox},
year = {2021},
eprint = {2109.12098},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2109.12098},
}Manipulation & Dexterous Hands操作与灵巧手VLA & Robot Foundation ModelsVLA 与机器人基础模型simreallanguageclippick-and-place