HIVE: Evaluating the Human Interpretability of Visual Explanations. (arXiv:2112.03184v4 [cs.CV] UPDATED)

As AI technology is increasingly applied to high-impact, high-risk domains,
there have been a number of new methods aimed at making AI models more human
interpretable. Despite the recent growth of interpretability work, there is a
lack of systematic evaluation of proposed techniques. In this work, we
introduce HIVE (Human Interpretability of Visual Explanations), a novel human
evaluation framework that assesses the utility of explanations to human users
in AI-assisted decision making scenarios, and enables falsifiable hypothesis
testing, cross-method comparison, …

arxiv cv hive human interpretability