GAIA: Categorical Foundations of Generative AI

arXiv:2402.18732v1 Announce Type: cross
Abstract: In this paper, we propose GAIA, a generative AI architecture based on category theory. GAIA is based on a hierarchical model where modules are organized as a simplicial complex. Each simplicial complex updates its internal parameters biased on information it receives from its superior simplices and in turn relays updates to its subordinate sub-simplices. Parameter updates are formulated in terms of lifting diagrams over simplicial sets, where inner and outer horn extensions correspond to different …

abstract architecture arxiv categorical cs.ai cs.lg generative hierarchical information modules paper parameters theory type updates