Coverage Aware Active Evaluation for Failure Discovery with Paired Systems
Finds real-system failures on a small budget by correcting cheap proxy (e.g. simulator) failure signals with residual modeling and choosing diverse, well-supported scenarios. Up to 2x the failures of random sampling.在有限测试预算下寻找真实系统的失败:用残差建模校正廉价代理(如仿真器)的失败信号,并挑选多样且有数据支撑的场景。发现的失败数最多为随机采样的 2 倍。
BibTeX
@misc{parashar2026coverage,
title = {{Coverage Aware Active Evaluation for Failure Discovery with Paired Systems}},
author = {Anjali Parashar and Rachel Luo and Apoorva Sharma and Sushant Veer and Edward Schmerling and Carson Sobolewski and Mingxin Yu and Chuchu Fan and Marco Pavone},
year = {2026},
eprint = {2608.13719},
archivePrefix = {arXiv},
primaryClass = {cs.AI},
url = {https://arxiv.org/abs/2608.13719},
}