all AI news
AMRFact: Enhancing Summarization Factuality Evaluation with AMR-Driven Negative Samples Generation
April 4, 2024, 4:48 a.m. | Haoyi Qiu, Kung-Hsiang Huang, Jingnong Qu, Nanyun Peng
cs.CL updates on arXiv.org arxiv.org
Abstract: Ensuring factual consistency is crucial for natural language generation tasks, particularly in abstractive summarization, where preserving the integrity of information is paramount. Prior works on evaluating factual consistency of summarization often take the entailment-based approaches that first generate perturbed (factual inconsistent) summaries and then train a classifier on the generated data to detect the factually inconsistencies during testing time. However, previous approaches generating perturbed summaries are either of low coherence or lack error-type coverage. To …
abstract amr arxiv cs.cl evaluation generate information integrity language language generation natural natural language natural language generation negative prior samples summarization tasks train type
More from arxiv.org / cs.CL updates on arXiv.org
Jobs in AI, ML, Big Data
Software Engineer for AI Training Data (School Specific)
@ G2i Inc | Remote
Software Engineer for AI Training Data (Python)
@ G2i Inc | Remote
Software Engineer for AI Training Data (Tier 2)
@ G2i Inc | Remote
Data Engineer
@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US