[R] Hacking an NLP benchmark: How to score 100 points on AMR parsing

AMR parsing is a fun task where researchers map texts onto little graphs that explicate their meaning, so called Abstract Meaning Representations (AMRs). While arguably not the top NLP benchmark regarding popularity, research has been active for the last 10 years, including at major NLP conferences such as ACL/NAACL/EACL/EMNLP etc.

Funnily, I recently found **some vulnerabilities** in the evaluation protocol, and if we exploit these vulnerabilities, we can **get the highest score on the benchmark**.

To get an overview over …

abstract amr benchmark conferences fun graphs hacking machinelearning major map meaning nlp parsing research researchers