Cross-Modal Entity Matching for Visually Rich Documents

arXiv:2303.00720v2 Announce Type: replace
Abstract: Visually rich documents (e.g. leaflets, banners, magazine articles) are physical or digital documents that utilize visual cues to augment their semantics. Information contained in these documents are ad-hoc and often incomplete. Existing works that enable structured querying on these documents do not take this into account. This makes it difficult to contextualize the information retrieved from querying these documents and gather actionable insights from them. We propose Juno -- a cross-modal entity matching framework to …

abstract articles arxiv cs.db cs.ir cs.lg digital documents information magazine modal semantics type visual visual cues