The Elements of Differentiable Programming

arXiv:2403.14606v1 Announce Type: new
Abstract: Artificial intelligence has recently experienced remarkable advances, fueled by large models, vast datasets, accelerated hardware, and, last but not least, the transformative power of differentiable programming. This new programming paradigm enables end-to-end differentiation of complex computer programs (including those with control flows and data structures), making gradient-based optimization of program parameters possible. As an emerging paradigm, differentiable programming builds upon several areas of computer science and applied mathematics, including automatic differentiation, graphical models, optimization and …

abstract advances artificial artificial intelligence arxiv computer control cs.ai cs.lg cs.pl data datasets differentiable differentiation gradient hardware intelligence large models least making optimization paradigm power programming type vast