Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biases

arXiv:2403.16396v1 Announce Type: new
Abstract: Definition bias is a negative phenomenon that can mislead models. Definition bias in information extraction appears not only across datasets from different domains but also within datasets sharing the same domain. We identify two types of definition bias in IE: bias among information extraction datasets and bias between information extraction datasets and instruction tuning datasets. To systematically investigate definition bias, we conduct three probing experiments to quantitatively analyze it and discover the limitations of unified …

arxiv biases cs.cl definition extraction information information extraction type