Seeking entropy: complex behavior from intrinsic motivation to occupy action-state path space. (arXiv:2205.10316v1 [cs.AI])

Intrinsic motivation generates behaviors that do not necessarily lead to
immediate reward, but help exploration and learning. Here we show that agents
having the sole goal of maximizing occupancy of future actions and states, that
is, moving and exploring on the long term, are capable of complex behavior
without any reference to external rewards. We find that action-state path
entropy is the only measure consistent with additivity and other intuitive
properties of expected future action-state path occupancy. We provide
analytical …

ai arxiv behavior entropy motivation path space state