📡 Embodied AI Radar具身智能雷达

Labs机构 › Allen Institute for AI (Ai2)艾伦人工智能研究所(Ai2)

Allen Institute for AI (Ai2) · embodied AI & robot learning艾伦人工智能研究所(Ai2) · 具身智能与机器人学习

4 curated papers, code, datasets and hardware from Allen Institute for AI (Ai2) (3 with code), with one-line takeaways.4 个来自艾伦人工智能研究所(Ai2)的精选论文、代码、数据集与硬件(3 个附代码),均配一句话要点。

Labs are matched from each entry's affiliation field by simple name rules (data/labs.yaml); joint work appears under every lab named. Only curated entries are listed, because daily arXiv papers carry no affiliations.机构由每个条目的机构字段按名称规则匹配(data/labs.yaml),合作工作会出现在所有署名机构下。仅列出精选条目,因为每日 arXiv 论文不含机构信息。

By topic:按主题: VLA & Robot Foundation ModelsVLA 与机器人基础模型 (1) · Manipulation & Dexterous Hands操作与灵巧手 (1) · Sim-to-Real & Simulators仿真与 Sim-to-Real (2) · Datasets & Benchmarks数据集与基准 (2)

All entries全部条目 (4)

Paper论文 2025 · Ai2, University of Washington

MolmoAct: Action Reasoning Models that can Reason in Space

An open 7B VLA that first outputs depth-aware perception tokens, then an editable 2D trajectory, then actions; reports 70.5% zero-shot on SimplerEnv and 86.6% on LIBERO, with weights, code and data released.开源 7B VLA,先输出深度感知 token,再生成可编辑的二维轨迹,最后输出动作;论文报告 SimplerEnv 零样本 70.5%、LIBERO 86.6%,并开放权重、代码和数据。

BibTeX
@misc{lee2025molmoact,
  title = {{MolmoAct: Action Reasoning Models that can Reason in Space}},
  author = {Jason Lee and Jiafei Duan and Haoquan Fang and Yuquan Deng and Shuo Liu and Boyang Li and Bohan Fang and Jieyu Zhang and Yi Ru Wang and Sangho Lee and Winson Han and Wilbert Pumacay and Angelica Wu and Rose Hendrix and Karen Farley and Eli VanderBilt and Ali Farhadi and Dieter Fox and Ranjay Krishna},
  year = {2025},
  eprint = {2508.07917},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2508.07917},
}
VLA & Robot Foundation ModelsVLA 与机器人基础模型realarmvlmopen-weightsreasoningspatial
Benchmark基准 2024 · UW · AI2 · USC · NVIDIA · UCSP RSS 2024

THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation

20 RLBench tasks × 14 perturbation factors (color, texture, lighting, distractors, camera pose, friction, mass…); reports 30–50% success drops for leading policies, 75%+ when perturbations combine.20 个 RLBench 任务 × 14 种扰动因素(颜色、纹理、光照、干扰物、相机位姿、摩擦、质量……);报告主流策略成功率下降 30–50%,多种扰动叠加时下降 75% 以上。

BibTeX
@misc{pumacay2024colosseum,
  title = {{THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation}},
  author = {Wilbert Pumacay and Ishika Singh and Jiafei Duan and Ranjay Krishna and Jesse Thomason and Dieter Fox},
  year = {2024},
  eprint = {2402.08191},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2402.08191},
}
Dataset数据集 2022 · Allen Institute for AI CVPR 2023

Objaverse: A Universe of Annotated 3D Objects

800K+ annotated 3D object models; widely used to populate simulators with diverse objects for grasping, rearrangement and procedural scene generation (Objaverse-XL extends it to 10M+).80 万+ 带标注的 3D 物体模型,常用于为仿真器填充多样物体,用于抓取、重排和程序化场景生成(Objaverse-XL 扩展到 1000 万+)。

BibTeX
@misc{deitke2022objaverse,
  title = {{Objaverse: A Universe of Annotated 3D Objects}},
  author = {Matt Deitke and Dustin Schwenk and Jordi Salvador and Luca Weihs and Oscar Michel and Eli VanderBilt and Ludwig Schmidt and Kiana Ehsani and Aniruddha Kembhavi and Ali Farhadi},
  year = {2022},
  eprint = {2212.08051},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2212.08051},
}
Paper论文 2017 · Allen Institute for AI

AI2-THOR: An Interactive 3D Environment for Visual AI

Photorealistic interactive indoor scenes where agents open, pick up and change objects; the base of many embodied-AI benchmarks such as ALFRED.具有可交互物体的逼真室内场景,智能体可开关、拾取和改变物体,是 ALFRED 等众多具身智能基准的基础。

BibTeX
@misc{kolve2017ai,
  title = {{AI2-THOR: An Interactive 3D Environment for Visual AI}},
  author = {Eric Kolve and Roozbeh Mottaghi and Winson Han and Eli VanderBilt and Luca Weihs and Alvaro Herrasti and Matt Deitke and Kiana Ehsani and Daniel Gordon and Yuke Zhu and Aniruddha Kembhavi and Abhinav Gupta and Ali Farhadi},
  year = {2017},
  eprint = {1712.05474},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/1712.05474},
}
Sim-to-Real & Simulators仿真与 Sim-to-Realhouseholdinteractiveembodied-agentsopen-source