One Agent to Guide Them All: Empowering MLLMs for Vision-and-Language Navigation via Explicit World Representation
Decouples spatial estimation from MLLM planning via an interactive metric world map plus counterfactual reasoning. Reports zero-shot 48.8% SR on R2R-CE and 42.2% on RxR-CE; runs on a TurtleBot 4 and a drone.通过可交互的度量世界表示把空间状态估计与多模态大模型的语义规划解耦，并引入反事实推理。报告零样本 R2R-CE 成功率 48.8%、RxR-CE 42.2%，并在 TurtleBot 4 与自制无人机上实机部署。
BibTeX
@misc{li2026one,
title = {{One Agent to Guide Them All: Empowering MLLMs for Vision-and-Language Navigation via Explicit World Representation}},
author = {Zerui Li and Hongpei Zheng and Fangguo Zhao and Aidan Chan and Jian Zhou and Sihao Lin and Shijie Li and Qi Wu},
year = {2026},
eprint = {2602.15400},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2602.15400},
}