NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks. (arXiv:2203.05081v1 [cs.CV])

Natural language explanation (NLE) models aim at explaining the
decision-making process of a black box system via generating natural language
sentences which are human-friendly, high-level and fine-grained. Current NLE
models explain the decision-making process of a vision or vision-language model
(a.k.a., task model), e.g., a VQA model, via a language model (a.k.a.,
explanation model), e.g., GPT. Other than the additional memory resources and
inference time required by the task model, the task and explanation models are
completely independent, which disassociates …

arxiv cv gpt language natural natural language nlx vision