HAVEN: Hierarchical Cooperative Multi-Agent Reinforcement Learning with Dual Coordination Mechanism. (arXiv:2110.07246v2 [cs.MA] UPDATED)

Multi-agent reinforcement learning often suffers from the exponentially large
action space caused by a large number of agents. This paper proposes a novel
value decomposition framework HAVEN based on hierarchical reinforcement
learning for the fully cooperative multi-agent problems. To address the
instability that arises from the concurrent optimization of high-level and
low-level policies and another concurrent optimization of agents, we introduce
the dual coordination mechanism of inter-layer strategies and inter-agent
strategies. HAVEN does not require domain knowledge and pretraining, and …

arxiv hierarchical learning reinforcement reinforcement learning