Tips to create a knowledge graph from documents using local models

I’m developing a chatbot for legal document navigation using a private LLM (Ollama) and encountering challenges with using local models for data pre-processing.

Project Overview:

• Goal: Create a chatbot for querying legal documents.
• Current State: Basic chat interface with Ollama LLM.
• Challenge: Need to answer complex queries spanning multiple documents, such as “Which contracts with client X expire this month?” or “Which statements of work are fixed price with X client”.

Proposed Solution:

• Implementing a graph …

basic challenge challenges chat chatbot current data datascience document documents graph knowledge knowledge graph legal llm navigation ollama overview pre-processing processing project state tips