Knowing Where to Look: Interactive Object Search via Spatial-Semantic Fusion
Fuses per-object VLM plausibility and geometric occupancy into one 3D voxel belief that decides where to look, go or open next; on a bimanual mobile humanoid it beats geometry-only search and LLM planning.把逐物体的 VLM 合理性评分与几何占据证据融合为统一的三维体素信念，决定下一步看哪、去哪、开哪个柜子；在双臂移动人形上优于纯几何搜索和 LLM 规划。
BibTeX
@misc{agarwal2026knowing,
title = {{Knowing Where to Look: Interactive Object Search via Spatial-Semantic Fusion}},
author = {Aditya Agarwal and Lucy Cai and Kelly Lu and Travis Manderson and Nicholas Roy and Tomás Lozano-Pérez and Leslie Pack Kaelbling},
year = {2026},
eprint = {2611.00499},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.00499},
}Manipulation & Dexterous Hands操作与灵巧手Navigation & Embodied Agents导航与具身智能体Robot arm机械臂Humanoid人形object-searchmobile-manipulationhumanoidreal