Beyond Extraction: Contextualising Tabular Data for Efficient Summarisation by Language Models

The conventional use of the Retrieval-Augmented Generation (RAG) architecture has proven effective for retrieving information from diverse documents. However, challenges arise in handling complex table queries, especially within PDF documents containing intricate tabular structures.This research introduces an innovative approach to enhance the accuracy of complex table queries in RAG-based systems. Our methodology involves storing PDFs in the retrieval database and extracting tabular content separately. The extracted tables undergo a process of context enrichment, concatenating headers with corresponding values. To ensure …

accuracy architecture beyond challenges cs.cl cs.lg data diverse documents extraction information language language models pdf rag research retrieval retrieval-augmented table tabular tabular data