Offline Reinforcement Learning with Implicit Q-Learning
IQL — learns values with expectile regression without ever querying actions outside the dataset, then extracts a policy by advantage-weighted regression; a common base for offline-to-online robot RL.IQL:用期望分位数回归学习价值函数、从不查询数据集外的动作,再用优势加权回归提取策略;是机器人离线到在线强化学习的常用基础。
BibTeX
@misc{kostrikov2021offline,
title = {{Offline Reinforcement Learning with Implicit Q-Learning}},
author = {Ilya Kostrikov and Ashvin Nair and Sergey Levine},
year = {2021},
eprint = {2110.06169},
archivePrefix = {arXiv},
primaryClass = {cs.LG},
url = {https://arxiv.org/abs/2110.06169},
}