PIGEON: VLM-Driven Object Navigation via Points of Interest Selection
Has a VLM pick among sparse 'points of interest' (frontiers, likely targets, stairs) tied to waypoints and raw views; planners do the motion. The checkable choices allow RLVR on local VLMs without CoT labels.让视觉语言模型在稀疏的“兴趣点”（探索前沿、疑似目标、楼梯等，每个绑定航点与原始视角）中做选择，底层规划器负责运动。这种可验证的决策使其能用 RLVR 训练本地 VLM，无需人工思维链标注。
BibTeX
@misc{peng2025pigeon,
title = {{PIGEON: VLM-Driven Object Navigation via Points of Interest Selection}},
author = {Cheng Peng and Zhenzhe Zhang and Xiaobao Wei and Yanhao Zhang and Heng Wang and Pengwei Wang and Zhongyuan Wang and Cheng Chi and Shanghang Zhang and Jing Liu},
year = {2025},
eprint = {2511.13207},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2511.13207},
}