UT Austin · embodied AI & robot learning得克萨斯大学奥斯汀分校 · 具身智能与机器人学习
7 curated papers, code, datasets and hardware from UT Austin (6 with code), with one-line takeaways.7 个来自得克萨斯大学奥斯汀分校的精选论文、代码、数据集与硬件(6 个附代码),均配一句话要点。
Labs are matched from each entry's affiliation field by simple name rules (data/labs.yaml); joint work appears under every lab named. Only curated entries are listed, because daily arXiv papers carry no affiliations.机构由每个条目的机构字段按名称规则匹配(data/labs.yaml),合作工作会出现在所有署名机构下。仅列出精选条目,因为每日 arXiv 论文不含机构信息。
@misc{liu2023libero,
title = {{LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning}},
author = {Bo Liu and Yifeng Zhu and Chongkai Gao and Yihao Feng and Qiang Liu and Yuke Zhu and Peter Stone},
year = {2023},
eprint = {2306.03310},
archivePrefix = {arXiv},
primaryClass = {cs.AI},
url = {https://arxiv.org/abs/2306.03310},
}
Extends MimicGen to humanoids with two dexterous hands, turning 60 human demos into 21K simulated ones across bimanual tasks, plus a real-to-sim-to-real pipeline tested on real can sorting.把 MimicGen 扩展到双灵巧手人形机器人,从 60 条人类演示生成 2.1 万条双臂仿真演示,并给出在真实分拣罐子任务上验证的 real-to-sim-to-real 流程。
@misc{jiang2024dexmimicgen,
title = {{DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning}},
author = {Zhenyu Jiang and Yuqi Xie and Kevin Lin and Zhenjia Xu and Weikang Wan and Ajay Mandlekar and Linxi Fan and Yuke Zhu},
year = {2024},
eprint = {2410.24185},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2410.24185},
}
120 kitchen scenes, 2,500+ objects and 100 tasks with generated demonstrations for training generalist policies.120 个厨房场景、2500 多个物体与 100 个任务,并附生成演示,用于训练通用策略。
@misc{nasiriany2024robocasa,
title = {{RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots}},
author = {Soroush Nasiriany and Abhiram Maddukuri and Lance Zhang and Adeet Parikh and Aaron Lo and Abhishek Joshi and Ajay Mandlekar and Yuke Zhu},
year = {2024},
eprint = {2406.02523},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2406.02523},
}
One modular teleop interface that mixes RGB-D body tracking, VR controllers, keyboard and joystick for whole-body mobile manipulators (Tiago++, HSR, Fetch), in sim and real.模块化遥操作接口,可组合 RGB-D 人体追踪、VR 手柄、键盘与摇杆,控制 Tiago++、HSR、Fetch 等移动操作机器人做全身动作,仿真和真机都支持。
@misc{dass2024telemoma,
title = {{TeleMoMa: A Modular and Versatile Teleoperation System for Mobile Manipulation}},
author = {Shivin Dass and Wensi Ai and Yuqian Jiang and Samik Singh and Jiaheng Hu and Ruohan Zhang and Peter Stone and Ben Abbatematteo and Roberto Martín-Martín},
year = {2024},
eprint = {2403.07869},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2403.07869},
}
Survey of how pretrained foundation models are used in robot perception, decision-making and control, and what holds them back — scarce robot data, safety and uncertainty, real-time execution.综述预训练基础模型如何用于机器人的感知、决策与控制,以及主要瓶颈:机器人数据稀缺、安全性与不确定性量化、实时执行。
@misc{firoozi2023foundation,
title = {{Foundation Models in Robotics: Applications, Challenges, and the Future}},
author = {Roya Firoozi and Johnathan Tucker and Stephen Tian and Anirudha Majumdar and Jiankai Sun and Weiyu Liu and Yuke Zhu and Shuran Song and Ashish Kapoor and Karol Hausman and Brian Ichter and Danny Driess and Jiajun Wu and Cewu Lu and Mac Schwager},
year = {2023},
eprint = {2312.07843},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2312.07843},
}
Turns a handful of human demos into thousands by splitting them into object-centric segments and replaying those segments in new scenes; widely reused to scale imitation data.把少量人类演示切分为以物体为中心的片段,并在新场景中变换重放,从而扩增为数千条演示;被广泛用于扩充模仿学习数据。
@misc{mandlekar2023mimicgen,
title = {{MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations}},
author = {Ajay Mandlekar and Soroush Nasiriany and Bowen Wen and Iretiayo Akinola and Yashraj Narang and Linxi Fan and Yuke Zhu and Dieter Fox},
year = {2023},
eprint = {2310.17596},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2310.17596},
}
@misc{zhu2020robosuite,
title = {{robosuite: A Modular Simulation Framework and Benchmark for Robot Learning}},
author = {Yuke Zhu and Josiah Wong and Ajay Mandlekar and Roberto Martín-Martín and Abhishek Joshi and Kevin Lin and Abhiram Maddukuri and Soroush Nasiriany and Yifeng Zhu},
year = {2020},
eprint = {2009.12293},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2009.12293},
}