NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation
A video VLM that reads the monocular RGB history plus the instruction and outputs the next navigation action directly, without maps, odometry or depth.基于视频的视觉语言模型:只看单目 RGB 历史帧和语言指令,直接输出下一步导航动作,不依赖地图、里程计或深度。
BibTeX
@misc{zhang2024navid,
title = {{NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation}},
author = {Jiazhao Zhang and Kunyu Wang and Rongtao Xu and Gengze Zhou and Yicong Hong and Xiaomeng Fang and Qi Wu and Zhizheng Zhang and He Wang},
year = {2024},
eprint = {2402.15852},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2402.15852},
}