HelpMeOut: A Neuropsychology-Grounded Benchmark for Error-Aware Monitoring of Household Task Execution
HelpMeOut: 20,000 paired household activity episodes with nine neuropsychology-based error types; agents must spot when a person's task execution goes wrong. Learned, symbolic and LLM monitors all do poorly.HelpMeOut:2 万对家务活动片段,涵盖九类基于神经心理学的执行错误,要求智能体尽早发现人做事出错。学习型、符号型与大模型监控方法表现都较差。
BibTeX
@misc{wang2026helpmeout,
title = {{HelpMeOut: A Neuropsychology-Grounded Benchmark for Error-Aware Monitoring of Household Task Execution}},
author = {Haoran Wang and Jingwei Huang and Anqing Duan and Ho Seok Ahn and Bruce Macdonald},
year = {2026},
eprint = {2610.17694},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.17694},
}