Benchmarking Counterfactual Image Generation

arXiv:2403.20287v1 Announce Type: cross
Abstract: Counterfactual image generation is pivotal for understanding the causal relations of variables, with applications in interpretability and generation of unbiased synthetic data. However, evaluating image generation is a long-standing challenge in itself. The need to evaluate counterfactual generation compounds on this challenge, precisely because counterfactuals, by definition, are hypothetical scenarios without observable ground truths. In this paper, we present a novel comprehensive framework aimed at benchmarking counterfactual image generation methods. We incorporate metrics that focus …

abstract applications arxiv benchmarking causal challenge counterfactual cs.cv cs.lg data definition however image image generation interpretability pivotal relations synthetic synthetic data type unbiased understanding variables