Multi-Page Document Visual Question Answering using Self-Attention Scoring Mechanism

arXiv:2404.19024v1 Announce Type: new
Abstract: Documents are 2-dimensional carriers of written communication, and as such their interpretation requires a multi-modal approach where textual and visual information are efficiently combined. Document Visual Question Answering (Document VQA), due to this multi-modal nature, has garnered significant interest from both the document understanding and natural language processing communities. The state-of-the-art single-page Document VQA methods show impressive performance, yet in multi-page scenarios, these methods struggle. They have to concatenate all pages into one large page …

arxiv attention cs.cv document page question question answering scoring self-attention type visual