Test Against High-Dimensional Uncertainties: Accelerated Evaluation of Autonomous Vehicles with Deep Importance Sampling. (arXiv:2204.02351v1 [cs.LG])

Evaluating the performance of autonomous vehicles (AV) and their complex
subsystems to high precision under naturalistic circumstances remains a
challenge, especially when failure or dangerous cases are rare. Rarity does not
only require an enormous sample size for a naive method to achieve high
confidence estimation, but it also causes dangerous underestimation of the true
failure rate and it is extremely hard to detect. Meanwhile, the
state-of-the-art approach that comes with a correctness guarantee can only
compute an upper bound …

arxiv autonomous autonomous vehicles evaluation sampling test