FEIJOA: Task-Driven Grounding and Execution for Mobile Manipulation
A language-model agent resolves instructions against a posed RGB-D scan at test time instead of a prebuilt representation; 35 of 50 real Spot trials succeed, and most failures come from physical skills.语言模型智能体在测试时对带位姿的 RGB-D 扫描做指令落地,不依赖预建表示;Spot 真机 50 次试验成功 35 次,失败大多来自物理技能而非推理。
BibTeX
@misc{agarwal2026feijoa,
title = {{FEIJOA: Task-Driven Grounding and Execution for Mobile Manipulation}},
author = {Aditya Agarwal and William Shen and Sahit Chintalapudi and Lucy Cai and Nishanth Kumar and Aidan Curtis and Travis Manderson and Tomás Lozano-Pérez and Leslie Pack Kaelbling},
year = {2026},
eprint = {2611.04080},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.04080},
}