Language as a Sensor: Calibrated Spatial Belief Estimation in 3D Scenes from Natural Language
Treats spoken descriptions ('my bag is on the table') as sensor readings: a model outputs a calibrated spatial distribution that is fused with onboard perception in one belief map. VLA-3D benchmark + real robot.把自然语言描述(如“包在桌上”)当作传感器观测:模型输出校准过的空间概率分布,并与机载感知融合到统一的信念地图中。在 VLA-3D 基准和真机上验证。
BibTeX
@misc{naveen2026language,
title = {{Language as a Sensor: Calibrated Spatial Belief Estimation in 3D Scenes from Natural Language}},
author = {Aryan Naveen and Jason Xinyu Liu and Luca Carlone and Andreea Bobu},
year = {2026},
eprint = {2606.08666},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2606.08666},
}