Equivariant Networks for Zero-Shot Coordination

arXiv:2210.12124v2 Announce Type: replace
Abstract: Successful coordination in Dec-POMDPs requires agents to adopt robust strategies and interpretable styles of play for their partner. A common failure mode is symmetry breaking, when agents arbitrarily converge on one out of many equivalent but mutually incompatible policies. Commonly these examples include partial observability, e.g. waving your right hand vs. left hand to convey a covert message. In this paper, we present a novel equivariant network architecture for use in Dec-POMDPs that effectively leverages …

abstract agents arxiv breaking converge cs.lg examples failure networks observability partner policies robust strategies symmetry type zero-shot