Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions
Discretizes each action dimension and predicts Q-values per dimension autoregressively with a Transformer, plus a conservative regularizer; trained offline on large real robot datasets mixing demos and autonomous data.将每个动作维度离散化，用 Transformer 自回归地逐维预测 Q 值，并加入保守正则；在混合演示与自主采集数据的大规模真实机器人数据集上离线训练。
BibTeX
@misc{chebotar2023q,
title = {{Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions}},
author = {Yevgen Chebotar and Quan Vuong and Alex Irpan and Karol Hausman and Fei Xia and Yao Lu and Aviral Kumar and Tianhe Yu and Alexander Herzog and Karl Pertsch and Keerthana Gopalakrishnan and Julian Ibarz and Ofir Nachum and Sumedh Sontakke and Grecia Salazar and Huong T Tran and Jodilyn Peralta and Clayton Tan and Deeksha Manjunath and Jaspiar Singht and Brianna Zitkovich and Tomas Jackson and Kanishka Rao and Chelsea Finn and Sergey Levine},
year = {2023},
eprint = {2309.10150},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2309.10150},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习Manipulation & Dexterous Hands操作与灵巧手realoffline-rltransformerlarge-scale