📡 Embodied AI Radar具身智能雷达

Labs机构 › University of Washington华盛顿大学

University of Washington · embodied AI & robot learning华盛顿大学 · 具身智能与机器人学习

9 curated papers, code, datasets and hardware from University of Washington (8 with code), with one-line takeaways.9 个来自华盛顿大学的精选论文、代码、数据集与硬件(8 个附代码),均配一句话要点。

Labs are matched from each entry's affiliation field by simple name rules (data/labs.yaml); joint work appears under every lab named. Only curated entries are listed, because daily arXiv papers carry no affiliations.机构由每个条目的机构字段按名称规则匹配(data/labs.yaml),合作工作会出现在所有署名机构下。仅列出精选条目,因为每日 arXiv 论文不含机构信息。

By topic:按主题: VLA & Robot Foundation ModelsVLA 与机器人基础模型 (5) · Manipulation & Dexterous Hands操作与灵巧手 (7) · Perception, SLAM & 3D Mapping感知、SLAM 与三维建图 (1) · Planning, Control & Safety规划、控制与安全 (1) · Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习 (2) · Datasets & Benchmarks数据集与基准 (2)

All entries全部条目 (9)

Paper论文 2025 · NVIDIA / UW / USC ICLR 2025

HAMSTER: Hierarchical Action Models for Open-World Robot Manipulation

A hierarchical VLA in which a fine-tuned VLM draws a coarse 2D path for the end effector on the image and a low-level 3D policy follows it, so the VLM can be trained on cheap off-domain data such as sim or videos.分层 VLA:微调后的 VLM 在图像上画出末端执行器的粗略二维路径,再由底层三维策略跟随执行;因此 VLM 可以用仿真、视频等低成本的非本域数据训练。

BibTeX
@misc{li2025hamster,
  title = {{HAMSTER: Hierarchical Action Models for Open-World Robot Manipulation}},
  author = {Yi Li and Yuquan Deng and Jesse Zhang and Joel Jang and Marius Memmel and Raymond Yu and Caelan Reed Garrett and Fabio Ramos and Dieter Fox and Anqi Li and Abhishek Gupta and Ankit Goyal},
  year = {2025},
  eprint = {2502.05485},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2502.05485},
}
Paper论文 2025 · Ai2, University of Washington

MolmoAct: Action Reasoning Models that can Reason in Space

An open 7B VLA that first outputs depth-aware perception tokens, then an editable 2D trajectory, then actions; reports 70.5% zero-shot on SimplerEnv and 86.6% on LIBERO, with weights, code and data released.开源 7B VLA,先输出深度感知 token,再生成可编辑的二维轨迹,最后输出动作;论文报告 SimplerEnv 零样本 70.5%、LIBERO 86.6%,并开放权重、代码和数据。

BibTeX
@misc{lee2025molmoact,
  title = {{MolmoAct: Action Reasoning Models that can Reason in Space}},
  author = {Jason Lee and Jiafei Duan and Haoquan Fang and Yuquan Deng and Shuo Liu and Boyang Li and Bohan Fang and Jieyu Zhang and Yi Ru Wang and Sangho Lee and Winson Han and Wilbert Pumacay and Angelica Wu and Rose Hendrix and Karen Farley and Eli VanderBilt and Ali Farhadi and Dieter Fox and Ranjay Krishna},
  year = {2025},
  eprint = {2508.07917},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2508.07917},
}
VLA & Robot Foundation ModelsVLA 与机器人基础模型realarmvlmopen-weightsreasoningspatial
Paper论文 2025 · UC Berkeley, University of Washington CoRL 2025

Steering Your Diffusion Policy with Latent Space Reinforcement Learning

DSRL — adapts a frozen diffusion policy by running RL over its input noise, not its weights; needs only forward passes, works with π0, and reports real-robot success rising from 20% to 90% in under 50 online episodes.DSRL:不改扩散策略的权重,而是对其输入的初始噪声做强化学习来"引导"输出动作;只需前向推理、可用于 π0,论文报告真机任务在不到 50 次在线交互内成功率从 20% 升至 90%。

BibTeX
@misc{wagenmaker2025steering,
  title = {{Steering Your Diffusion Policy with Latent Space Reinforcement Learning}},
  author = {Andrew Wagenmaker and Mitsuhiko Nakamoto and Yunchu Zhang and Seohong Park and Waleed Yagoub and Anusha Nagabandi and Abhishek Gupta and Sergey Levine},
  year = {2025},
  eprint = {2506.15799},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2506.15799},
}
Paper论文 2024 · KAIST / UW / Microsoft Research / NVIDIA ICLR 2025

Latent Action Pretraining from Videos

LAPA pretrains a VLA without action labels: it learns discrete latent actions between video frames, predicts them from image + text, then maps them to robot actions; reports beating OpenVLA on real tasks.LAPA 无需动作标注即可预训练 VLA:先从视频相邻帧间学习离散隐动作,再训练模型由图像和指令预测隐动作,最后用少量机器人数据映射到真实动作;报告在真机任务上优于 OpenVLA。

BibTeX
@misc{ye2024latent,
  title = {{Latent Action Pretraining from Videos}},
  author = {Seonghyeon Ye and Joel Jang and Byeongguk Jeon and Sejune Joo and Jianwei Yang and Baolin Peng and Ajay Mandlekar and Reuben Tan and Yu-Wei Chao and Bill Yuchen Lin and Lars Liden and Kimin Lee and Jianfeng Gao and Luke Zettlemoyer and Dieter Fox and Minjoon Seo},
  year = {2024},
  eprint = {2410.11758},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2410.11758},
}
Benchmark基准 2024 · UW · AI2 · USC · NVIDIA · UCSP RSS 2024

THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation

20 RLBench tasks × 14 perturbation factors (color, texture, lighting, distractors, camera pose, friction, mass…); reports 30–50% success drops for leading policies, 75%+ when perturbations combine.20 个 RLBench 任务 × 14 种扰动因素(颜色、纹理、光照、干扰物、相机位姿、摩擦、质量……);报告主流策略成功率下降 30–50%,多种扰动叠加时下降 75% 以上。

BibTeX
@misc{pumacay2024colosseum,
  title = {{THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation}},
  author = {Wilbert Pumacay and Ishika Singh and Jiafei Duan and Ranjay Krishna and Jesse Thomason and Dieter Fox},
  year = {2024},
  eprint = {2402.08191},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2402.08191},
}
Paper论文 2022 · NVIDIA · University of Washington

Motion Policy Networks

A neural policy trained on millions of planner-generated trajectories that moves an arm to goals straight from point clouds.在数百万条规划器生成的轨迹上训练的神经策略,可直接根据点云把机械臂移动到目标位置。

BibTeX
@misc{fishman2022motion,
  title = {{Motion Policy Networks}},
  author = {Adam Fishman and Adithyavairan Murali and Clemens Eppner and Bryan Peele and Byron Boots and Dieter Fox},
  year = {2022},
  eprint = {2210.12209},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2210.12209},
}
Paper论文 2022 · University of Washington, NVIDIA CoRL 2022

Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation

PerAct — a Perceiver Transformer over voxelized RGB-D observations that predicts the next keyframe gripper pose as voxel classification; one language-conditioned policy for many RLBench and real tasks.PerAct:在体素化的 RGB-D 观测上运行 Perceiver Transformer,把下一关键帧夹爪位姿当作体素分类来预测;一个语言条件策略即可覆盖众多 RLBench 与真机任务。

BibTeX
@misc{shridhar2022perceiver,
  title = {{Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation}},
  author = {Mohit Shridhar and Lucas Manuelli and Dieter Fox},
  year = {2022},
  eprint = {2209.05451},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2209.05451},
}
Paper论文 2021 · University of Washington, NVIDIA CoRL 2021

CLIPort: What and Where Pathways for Robotic Manipulation

CLIPort — combines CLIP's semantic "what" stream with Transporter's spatial "where" stream for language-conditioned tabletop manipulation; an early bridge from web vision-language models to robot actions.CLIPort:把 CLIP 提供的语义"是什么"通路与 Transporter 的空间"在哪里"通路结合,实现语言条件的桌面操作;是较早把网络视觉语言模型接入机器人动作的工作。

BibTeX
@misc{shridhar2021cliport,
  title = {{CLIPort: What and Where Pathways for Robotic Manipulation}},
  author = {Mohit Shridhar and Lucas Manuelli and Dieter Fox},
  year = {2021},
  eprint = {2109.12098},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2109.12098},
}
Dataset数据集 2021 · NVIDIA · University of Washington CVPR 2021

DexYCB: A Benchmark for Capturing Hand Grasping of Objects

~582K RGB-D frames (1,000 sequences, 10 people, 20 YCB objects, 8 cameras) of human grasps with hand and object pose labels; benchmarks detection, 6D object pose, 3D hand pose and human-to-robot handover.约 58.2 万帧 RGB-D(1000 段序列、10 人、20 个 YCB 物体、8 台相机)的人手抓取数据,带手部与物体位姿标注;评测检测、物体 6D 位姿、三维手部姿态及人到机器人的物体交接。

BibTeX
@misc{chao2021dexycb,
  title = {{DexYCB: A Benchmark for Capturing Hand Grasping of Objects}},
  author = {Yu-Wei Chao and Wei Yang and Yu Xiang and Pavlo Molchanov and Ankur Handa and Jonathan Tremblay and Yashraj S. Narang and Karl Van Wyk and Umar Iqbal and Stan Birchfield and Jan Kautz and Dieter Fox},
  year = {2021},
  eprint = {2104.04631},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2104.04631},
}