[R] ExSum: From Local Explanations to Model Understanding

Web: https://www.reddit.com/r/MachineLearning/comments/uixbwk/r_exsum_from_local_explanations_to_model/

Excited to share our latest research on model interpretability, to appear at NAACL this summer.

In this paper, we reflect on local model explanations (e.g. LIME, SHAP, gradient saliency), and think about how people actually use them to derive high-level model understanding (e.g. is the model relying on spurious correlation, is it biased, can I trust it).

Obviously, they need to be correct (or faithful), which has been the focus of many interpretability evaluations. However, we argue that they also …

machinelearning model