The effectiveness of feature attribution methods and its correlation with automatic evaluation scores. (arXiv:2105.14944v4 [cs.CV] UPDATED)

Web: http://arxiv.org/abs/2105.14944

Explaining the decisions of an Artificial Intelligence (AI) model is
increasingly critical in many real-world, high-stake applications. Hundreds of
papers have either proposed new feature attribution methods, discussed or
harnessed these tools in their work. However, despite humans being the target
end-users, most attribution methods were only evaluated on proxy
automatic-evaluation metrics (Zhang et al. 2018; Zhou et al. 2016; Petsiuk et
al. 2018). In this paper, we conduct the first user study to measure
attribution map effectiveness in assisting …

arxiv attribution correlation cv evaluation