Compete and Compose: Learning Independent Mechanisms for Modular World Models

arXiv:2404.15109v1 Announce Type: new
Abstract: We present COmpetitive Mechanisms for Efficient Transfer (COMET), a modular world model which leverages reusable, independent mechanisms across different environments. COMET is trained on multiple environments with varying dynamics via a two-step process: competition and composition. This enables the model to recognise and learn transferable mechanisms. Specifically, in the competition phase, COMET is trained with a winner-takes-all gradient allocation, encouraging the emergence of independent mechanisms. These are then re-used in the composition phase, where COMET …

abstract arxiv comet competition cs.lg dynamics environments independent learn modular multiple process transfer type via world world model world models