FIZZ: Factual Inconsistency Detection by Zoom-in Summary and Zoom-out Document

arXiv:2404.11184v1 Announce Type: new
Abstract: Through the advent of pre-trained language models, there have been notable advancements in abstractive summarization systems. Simultaneously, a considerable number of novel methods for evaluating factual consistency in abstractive summarization systems has been developed. But these evaluation approaches incorporate substantial limitations, especially on refinement and interpretability. In this work, we propose highly effective and interpretable factual inconsistency detection method metric Factual Inconsistency Detection by Zoom-in Summary and Zoom-out Document for abstractive summarization systems that is …

arxiv cs.cl detection document summary type zoom