Think While You Write: Hypothesis Verification Promotes Faithful Knowledge-to-Text Generation

arXiv:2311.09467v2 Announce Type: replace
Abstract: Knowledge-to-text generators often struggle to faithfully generate descriptions for the input facts: they may produce hallucinations that contradict the input, or describe facts not present in the input. To reduce hallucinations, we propose a decoding-only method, TWEAK (Think While Effectively Articulating Knowledge), which can be integrated with any generator without retraining. TWEAK treats the generated sequences at each decoding step and its future sequences as hypotheses, and ranks each generation candidate based on the extent …

abstract arxiv cs.ai cs.cl decoding facts generate generators hallucinations hypothesis knowledge reduce struggle text text generation think type verification