Unofficial Gradient without backpropagation

We have recently created an unofficial implementation of the paper https://arxiv.org/abs/2202.08587

The repo https://github.com/orobix/fwdgrad is developed in Pytorch using the new library functorch https://pytorch.org/functorch/stable/.

We don't achieve the same results as the paper described, but it might be a problem with functorch being in its early development.

If anyone interested wants to give us any feedback or try it out, feel free.

backpropagation deeplearning gradient