Reading Order Independent Metrics for Information Extraction in Handwritten Documents

arXiv:2404.18664v1 Announce Type: new
Abstract: Information Extraction processes in handwritten documents tend to rely on obtaining an automatic transcription and performing Named Entity Recognition (NER) over such transcription. For this reason, in publicly available datasets, the performance of the systems is usually evaluated with metrics particular to each dataset. Moreover, most of the metrics employed are sensitive to reading order errors. Therefore, they do not reflect the expected final application of the system and introduce biases in more complex documents. …

abstract arxiv cs.cv dataset datasets documents extraction independent information information extraction metrics ner performance processes reading reason recognition systems transcription type