[R] Numerical Instability in Some Optimizers for training Neural Network

I found an interesting arxiv paper mentioning that some optimizers can occur numerical instability for training neural network.

Link: [https://arxiv.org/abs/2307.16189](https://arxiv.org/abs/2307.16189)

This can be a simple approach for low-precision neural network with 16-bit and future 8-bit or 4-bit.

16-bit arxiv found future low machinelearning network neural network numerical paper precision simple training