Columbia University · embodied AI & robot learning哥伦比亚大学 · 具身智能与机器人学习
6 curated papers, code, datasets and hardware from Columbia University (4 with code), with one-line takeaways.6 个来自哥伦比亚大学的精选论文、代码、数据集与硬件（4 个附代码），均配一句话要点。
Labs are matched from each entry's affiliation field by simple name rules (data/labs.yaml); joint work appears under every lab named. Only curated entries are listed, because daily arXiv papers carry no affiliations.机构由每个条目的机构字段按名称规则匹配（data/labs.yaml），合作工作会出现在所有署名机构下。仅列出精选条目，因为每日 arXiv 论文不含机构信息。
@misc{chi2024universal,
title = {{Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots}},
author = {Cheng Chi and Zhenjia Xu and Chuer Pan and Eric Cousineau and Benjamin Burchfiel and Siyuan Feng and Russ Tedrake and Shuran Song},
year = {2024},
eprint = {2402.10329},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2402.10329},
}
Generating action sequences by denoising handles multimodal demos far better than regression; now a standard IL baseline.以去噪方式生成动作序列，比回归更能处理多模态演示，已成为模仿学习标准基线。
@misc{chi2023diffusion,
title = {{Diffusion Policy: Visuomotor Policy Learning via Action Diffusion}},
author = {Cheng Chi and Zhenjia Xu and Siyuan Feng and Eric Cousineau and Yilun Du and Benjamin Burchfiel and Russ Tedrake and Shuran Song},
year = {2023},
eprint = {2303.04137},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2303.04137},
}
DexUMI — an exoskeleton matched to the robot hand's fingertip workspace, plus inpainting that swaps the human hand for the robot's; reports 86% average success (Inspire, XHand) and ~3.2× faster collection than teleop.DexUMI：按目标机器人手的指尖工作空间设计的可穿戴手部外骨骼，再用视频修补把画面中的人手换成机器人手；论文报告在 Inspire 与 XHand 上平均成功率 86%，采集效率约为遥操作的 3.2 倍。
@misc{xu2025dexumi,
title = {{DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulation}},
author = {Mengda Xu and Han Zhang and Yifan Hou and Zhenjia Xu and Linxi Fan and Manuela Veloso and Shuran Song},
year = {2025},
eprint = {2505.21864},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2505.21864},
}
@misc{huang2024d,
title = {{3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing}},
author = {Binghao Huang and Yixuan Wang and Xinyi Yang and Yiyue Luo and Yunzhu Li},
year = {2024},
eprint = {2410.24091},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2410.24091},
}
ReKep — a VLM writes manipulation tasks as Python cost functions over 3D keypoints (relational keypoint constraints), solved by a hierarchical optimizer in real time; zero-shot, no task-specific training.ReKep：由视觉语言模型把操作任务写成定义在三维关键点上的 Python 代价函数（关系关键点约束），再由分层优化器实时求解；零样本，无需针对任务训练。
@misc{huang2024rekep,
title = {{ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation}},
author = {Wenlong Huang and Chen Wang and Yunzhu Li and Ruohan Zhang and Li Fei-Fei},
year = {2024},
eprint = {2409.01652},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2409.01652},
}
CLIP on Wheels pairs open-vocabulary localization (CLIP-style models, no fine-tuning) with classical exploration for zero-shot object navigation; the Pasture benchmark adds rare, attribute-described and hidden objects.CoWs on Pasture：CLIP on Wheels 把开放词汇定位（CLIP 等模型，无需微调）与经典探索结合，实现零样本目标物体导航；配套的 Pasture 基准加入了少见物体、按属性描述的物体和被遮挡物体。
@misc{gadre2022cows,
title = {{CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation}},
author = {Samir Yitzhak Gadre and Mitchell Wortsman and Gabriel Ilharco and Ludwig Schmidt and Shuran Song},
year = {2022},
eprint = {2203.10421},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2203.10421},
}