Gaining More Insight into Neural Semantic Parsing with Challenging Benchmarks

arXiv:2404.08354v1 Announce Type: new
Abstract: The Parallel Meaning Bank (PMB) serves as a corpus for semantic processing with a focus on semantic parsing and text generation. Currently, we witness an excellent performance of neural parsers and generators on the PMB. This might suggest that such semantic processing tasks have by and large been solved. We argue that this is not the case and that performance scores from the past on the PMB are inflated by non-optimal data splits and test …

abstract arxiv bank benchmarks cs.cl focus generators insight meaning parsing performance processing semantic tasks text text generation type witness