[P] fMRaI: Neural network interpretability and explainability library

Hi everyone,

I recently saw a post about [Comgra](https://www.reddit.com/r/MachineLearning/comments/1824cfs/p_comgra_a_library_for_debugging_and/) in this sub-reddit (check it out, it's very cool!), which inspired me to share a similar pet project of mine - mine has a slightly different goal.

I've been very interested in understanding how LLMs work behind the scenes, and I've started reading a bunch of cool papers like:

* [What Does BERT Look At? An Analysis of BERT's Attention](https://arxiv.org/abs/1906.04341): It shows how attention heads learn very specific functions (like finding …

black boxes explainability interpretability library llms machinelearning network neural network reading understanding work