LM Transparency Tool: Interactive Tool for Analyzing Transformer Language Models

arXiv:2404.07004v1 Announce Type: new
Abstract: We present the LM Transparency Tool (LM-TT), an open-source interactive toolkit for analyzing the internal workings of Transformer-based language models. Differently from previously existing tools that focus on isolated parts of the decision-making process, our framework is designed to make the entire prediction process transparent, and allows tracing back model behavior from the top-layer representation to very fine-grained parts of the model. Specifically, it (1) shows the important part of the whole input-to-output information flow, …

abstract arxiv cs.cl decision focus framework interactive language language models making prediction process tool toolkit tools transformer transformer language models transparency transparent type