Web: http://arxiv.org/abs/2110.08555

May 5, 2022, 1:11 a.m. | Jun Yan, Yang Xiao, Sagnik Mukherjee, Bill Yuchen Lin, Robin Jia, Xiang Ren

cs.CL updates on arXiv.org arxiv.org

We study the robustness of machine reading comprehension (MRC) models to
entity renaming -- do models make more wrong predictions when the same
questions are asked about an entity whose name has been changed? Such failures
imply that models overly rely on entity information to answer questions, and
thus may generalize poorly when facts about the world change or questions are
asked about novel entities. To systematically audit this issue, we present a
pipeline to automatically generate test examples at …

arxiv models on reading robustness

More from arxiv.org / cs.CL updates on arXiv.org

Director, Applied Mathematics & Computational Research Division

@ Lawrence Berkeley National Lab | Berkeley, Ca

Business Data Analyst

@ MainStreet Family Care | Birmingham, AL

Assistant/Associate Professor of the Practice in Business Analytics

@ Georgetown University McDonough School of Business | Washington DC

Senior Data Science Writer

@ NannyML | Remote

Director of AI/ML Engineering

@ Armis Industries | Remote (US only), St. Louis, California

Digital Analytics Manager

@ Patagonia | Ventura, California