Feedback on NanoDL, a new library for building transformer models.

Hey guys, I just published the developer version of NanoDL, a library for developing transformer models within the Jax/Flax ecosystem and would love your feedback!

Key Features of NanoDL include:

* A wide array of blocks and layers, facilitating the creation of customised transformer models from scratch.
* An extensive selection of models like LlaMa2, Mistral, Mixtral, GPT3, GPT4 (inferred), T5, Whisper, ViT, Mixers, GAT, CLIP, and more, catering to a variety of tasks and applications.
* Data-parallel distributed trainers …

array building deeplearning developer ecosystem features feedback hey jax key library love transformer transformer models