📡 Embodied AI Radar具身智能雷达

Labs机构 › UT Austin得克萨斯大学奥斯汀分校

UT Austin · embodied AI & robot learning得克萨斯大学奥斯汀分校 · 具身智能与机器人学习

7 curated papers, code, datasets and hardware from UT Austin (6 with code), with one-line takeaways.7 个来自得克萨斯大学奥斯汀分校的精选论文、代码、数据集与硬件(6 个附代码),均配一句话要点。

Labs are matched from each entry's affiliation field by simple name rules (data/labs.yaml); joint work appears under every lab named. Only curated entries are listed, because daily arXiv papers carry no affiliations.机构由每个条目的机构字段按名称规则匹配(data/labs.yaml),合作工作会出现在所有署名机构下。仅列出精选条目,因为每日 arXiv 论文不含机构信息。

By topic:按主题: VLA & Robot Foundation ModelsVLA 与机器人基础模型 (1) · Manipulation & Dexterous Hands操作与灵巧手 (3) · Sim-to-Real & Simulators仿真与 Sim-to-Real (4) · Datasets & Benchmarks数据集与基准 (5) · Hardware & Open-Source Robots硬件与开源机器人 (1)

All entries全部条目 (7)

Benchmark基准 2023 · UT Austin ★

LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning

130 language-conditioned tasks in four suites; now the most common simulation benchmark for VLA papers.四个套件共 130 个语言条件任务,现已成为 VLA 论文最常用的仿真基准。

BibTeX
@misc{liu2023libero,
  title = {{LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning}},
  author = {Bo Liu and Yifeng Zhu and Chongkai Gao and Yihao Feng and Qiang Liu and Yuke Zhu and Peter Stone},
  year = {2023},
  eprint = {2306.03310},
  archivePrefix = {arXiv},
  primaryClass = {cs.AI},
  url = {https://arxiv.org/abs/2306.03310},
}
Datasets & Benchmarks数据集与基准simmanipulationlifelong-learning
Paper论文 2024 · NVIDIA, UT Austin ICRA 2025

DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning

Extends MimicGen to humanoids with two dexterous hands, turning 60 human demos into 21K simulated ones across bimanual tasks, plus a real-to-sim-to-real pipeline tested on real can sorting.把 MimicGen 扩展到双灵巧手人形机器人,从 60 条人类演示生成 2.1 万条双臂仿真演示,并给出在真实分拣罐子任务上验证的 real-to-sim-to-real 流程。

BibTeX
@misc{jiang2024dexmimicgen,
  title = {{DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning}},
  author = {Zhenyu Jiang and Yuqi Xie and Kevin Lin and Zhenjia Xu and Weikang Wan and Ajay Mandlekar and Linxi Fan and Yuke Zhu},
  year = {2024},
  eprint = {2410.24185},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2410.24185},
}
Sim-to-Real & Simulators仿真与 Sim-to-RealManipulation & Dexterous Hands操作与灵巧手Datasets & Benchmarks数据集与基准Robot arm机械臂Dexterous hand灵巧手Humanoid人形simhumanoiddexterous-handbimanualdata-generationimitation
Paper论文 2024 · UT Austin, NVIDIA

RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots

120 kitchen scenes, 2,500+ objects and 100 tasks with generated demonstrations for training generalist policies.120 个厨房场景、2500 多个物体与 100 个任务,并附生成演示,用于训练通用策略。

BibTeX
@misc{nasiriany2024robocasa,
  title = {{RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots}},
  author = {Soroush Nasiriany and Abhiram Maddukuri and Lance Zhang and Adeet Parikh and Aaron Lo and Abhishek Joshi and Ajay Mandlekar and Yuke Zhu},
  year = {2024},
  eprint = {2406.02523},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2406.02523},
}
Hardware硬件 2024 · UT Austin, Stanford, Sony AI

TeleMoMa: A Modular and Versatile Teleoperation System for Mobile Manipulation

One modular teleop interface that mixes RGB-D body tracking, VR controllers, keyboard and joystick for whole-body mobile manipulators (Tiago++, HSR, Fetch), in sim and real.模块化遥操作接口,可组合 RGB-D 人体追踪、VR 手柄、键盘与摇杆,控制 Tiago++、HSR、Fetch 等移动操作机器人做全身动作,仿真和真机都支持。

BibTeX
@misc{dass2024telemoma,
  title = {{TeleMoMa: A Modular and Versatile Teleoperation System for Mobile Manipulation}},
  author = {Shivin Dass and Wensi Ai and Yuqian Jiang and Samik Singh and Jiaheng Hu and Ruohan Zhang and Peter Stone and Ben Abbatematteo and Roberto Martín-Martín},
  year = {2024},
  eprint = {2403.07869},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2403.07869},
}
Hardware & Open-Source Robots硬件与开源机器人Manipulation & Dexterous Hands操作与灵巧手Robot arm机械臂Mobile robot移动机器人teleoperationmobile-manipulationwhole-body
Paper论文 2023 · Stanford, Princeton, UT Austin, Google DeepMind and others IJRR 2024

Foundation Models in Robotics: Applications, Challenges, and the Future

Survey of how pretrained foundation models are used in robot perception, decision-making and control, and what holds them back — scarce robot data, safety and uncertainty, real-time execution.综述预训练基础模型如何用于机器人的感知、决策与控制,以及主要瓶颈:机器人数据稀缺、安全性与不确定性量化、实时执行。

BibTeX
@misc{firoozi2023foundation,
  title = {{Foundation Models in Robotics: Applications, Challenges, and the Future}},
  author = {Roya Firoozi and Johnathan Tucker and Stephen Tian and Anirudha Majumdar and Jiankai Sun and Weiyu Liu and Yuke Zhu and Shuran Song and Ashish Kapoor and Karol Hausman and Brian Ichter and Danny Driess and Jiajun Wu and Cewu Lu and Mac Schwager},
  year = {2023},
  eprint = {2312.07843},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2312.07843},
}
Paper论文 2023 · NVIDIA, UT Austin CoRL 2023

MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations

Turns a handful of human demos into thousands by splitting them into object-centric segments and replaying those segments in new scenes; widely reused to scale imitation data.把少量人类演示切分为以物体为中心的片段,并在新场景中变换重放,从而扩增为数千条演示;被广泛用于扩充模仿学习数据。

BibTeX
@misc{mandlekar2023mimicgen,
  title = {{MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations}},
  author = {Ajay Mandlekar and Soroush Nasiriany and Bowen Wen and Iretiayo Akinola and Yashraj Narang and Linxi Fan and Yuke Zhu and Dieter Fox},
  year = {2023},
  eprint = {2310.17596},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2310.17596},
}
Paper论文 2020 · Stanford, UT Austin

robosuite: A Modular Simulation Framework and Benchmark for Robot Learning

Modular MuJoCo-based manipulation environments behind many imitation-learning benchmarks.基于 MuJoCo 的模块化操作环境,是众多模仿学习基准的底座。

BibTeX
@misc{zhu2020robosuite,
  title = {{robosuite: A Modular Simulation Framework and Benchmark for Robot Learning}},
  author = {Yuke Zhu and Josiah Wong and Ajay Mandlekar and Roberto Martín-Martín and Abhishek Joshi and Kevin Lin and Abhiram Maddukuri and Soroush Nasiriany and Yifeng Zhu},
  year = {2020},
  eprint = {2009.12293},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2009.12293},
}