[R] Categorical Deep Learning: An Algebraic Theory of Architectures

**Paper**: [https://arxiv.org/abs/2402.15332](https://arxiv.org/abs/2402.15332)

**Project page**: [https://categoricaldeeplearning.com/](https://categoricaldeeplearning.com/)

**Abstract**:

>We present our position on the elusive quest for a general-purpose framework for specifying and studying deep learning architectures. Our opinion is that the key attempts made so far lack a coherent bridge between specifying *constraints* which models must satisfy and specifying their *implementations*. Focusing on building a such a bridge, we propose to apply category theory -- precisely, the universal *algebra of monads* valued in a 2-category of *parametric maps* -- as a …

abstract apply architectures bridge building constraints deep learning framework general key machinelearning opinion quest studying the key theory