A Closer Look at Claim Decomposition

arXiv:2403.11903v1 Announce Type: new
Abstract: As generated text becomes more commonplace, it is increasingly important to evaluate how well-supported such text is by external knowledge sources. Many approaches for evaluating textual support rely on some method for decomposing text into its individual subclaims which are scored against a trusted reference. We investigate how various methods of claim decomposition -- especially LLM-based methods -- affect the result of an evaluation approach such as the recently proposed FActScore, finding that it is …

abstract arxiv claim closer look cs.cl generated knowledge look reference support text textual type