GROW$^2$: Grounding Which and Where for Robot Tool Use

Creative tool use (cut a cake with a plate): a VLM picks the object to use as a tool and the relevant parts, then vision foundation models ground those parts as 3D regions from one RGB-D image. No end-to-end training.创造性用工具（没有刀就用盘子切蛋糕）：VLM 选出可充当工具的物体及其相关部位，再由视觉基础模型从单张 RGB-D 图像把这些部位定位为 3D 区域。无需端到端训练。

@misc{deng2026grow,
  title = {{GROW$^2$: Grounding Which and Where for Robot Tool Use}},
  author = {Yuhong Deng and Yuyao Liu and David Hsu},
  year = {2026},
  eprint = {2606.30632},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2606.30632},
}