A Survey of Constraint Formulations in Safe Reinforcement Learning

Ensuring safety is critical when applying reinforcement learning (RL) to real-world problems. Consequently, safe RL emerges as a fundamental and powerful paradigm for safely optimizing an agent's policy from experimental data. A popular safe RL approach is based on a constrained criterion, which solves the problem of maximizing expected cumulative reward under safety constraints. Though there has been recently a surge of such attempts to achieve safety in RL, a systematic understanding of the field is difficult due to 1) …

agent criterion cs.ai cs.lg data experimental paradigm policy popular reinforcement reinforcement learning safety survey world