[R] Exponentially Faster Feedforward Networks

**TL;DR:** Almost like your feedforward networks, shown to be up to 220x faster (depending on width) thanks to regionalization of the input space.

Paper: [https://arxiv.org/abs/2308.14711](https://arxiv.org/abs/2308.14711)

GitHub: [https://github.com/pbelcak/fastfeedforward](https://github.com/pbelcak/fastfeedforward)

PyPI: `pip install fastfeedforward`

Abstract:

>We break the linear link between the layer size and its inference cost by introducing the fast feedforward (FFF) architecture, a log-time alternative to feedforward networks. We demonstrate that FFFs are up to 220x faster than feedforward networks, up to 6x faster than mixture-of-experts networks, and exhibit better …

abstract architecture cost faster inference install linear machinelearning networks pip pypi space