HiRE: Hindsight Reward Editing for Policy Finetuning
Training-free reward editing: compares successful and failed rollouts in hindsight to penalize trap states that foundation-model rewards rate highly. Reports at least 3x the base policy's performance.免训练的奖励修正:事后对比成功与失败轨迹,惩罚被基础模型奖励高估、最终却导致失败的“陷阱状态”。报告性能至少是基础策略的 3 倍。
BibTeX
@misc{niu2026hire,
title = {{HiRE: Hindsight Reward Editing for Policy Finetuning}},
author = {Haoyi Niu and Zhengtao Han and Yufeng Ji and Zhongyu Li and Koushil Sreenath},
year = {2026},
eprint = {2609.27068},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2609.27068},
}