T-RAG: Lessons from the LLM Trenches

An important application area is question answering over private enterprise documents where the main considerations are data security, which necessitates applications that can be deployed on-prem, [and] limited computational resources. [...] In addition to retrieving contextual documents, we use the spaCy library with custom rules to detect named entities from the organization.

application applications computational data data security documents enterprise library llm llms on-prem organization paper question question answering rag resources rules security spacy