BART/GPT learning visualisation (Attention visualisation ...)

Hi,

I am looking for a way to make abstractive summarisation (BART) and/or fine tuning of language models (especially GPT-2) more explainable.

My goal is to show a shift towards the training domain by comparing the base model and the fine tuned model. Therefore, I had a look in SHAP for both approaches but am interested in any other framework on how to visualise such learning progress.

I am happy for any leads :)

attention bart gpt languagetechnology learning