RVT: Robotic View Transformer for 3D Object Manipulation
RVT — re-renders the point cloud into a few virtual views and uses a multi-view Transformer to predict keyframe poses; reported to train and run much faster than voxel-based PerAct on RLBench. Repo also hosts RVT-2.RVT:把点云重新渲染为若干虚拟视角,再用多视角 Transformer 预测关键帧位姿;论文报告在 RLBench 上训练与推理都比基于体素的 PerAct 快得多。代码库同时包含 RVT-2。
BibTeX
@misc{goyal2023rvt,
title = {{RVT: Robotic View Transformer for 3D Object Manipulation}},
author = {Ankit Goyal and Jie Xu and Yijie Guo and Valts Blukis and Yu-Wei Chao and Dieter Fox},
year = {2023},
eprint = {2306.14896},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2306.14896},
}