LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action
Chains an LLM (parses landmarks from the instruction), CLIP (finds them in images) and a visual navigation model to follow route instructions on a real robot without language-annotated robot data.将大语言模型(从指令中解析地标)、CLIP(在图像中找到地标)与视觉导航模型串联,无需带语言标注的机器人数据即可在真实机器人上按路线指令导航。
BibTeX
@misc{shah2022lm,
title = {{LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action}},
author = {Dhruv Shah and Blazej Osinski and Brian Ichter and Sergey Levine},
year = {2022},
eprint = {2207.04429},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2207.04429},
}Navigation & Embodied Agents导航与具身智能体VLA & Robot Foundation ModelsVLA 与机器人基础模型realwheeledlanguagefoundation-modelszero-shot