Feb. 24, 2024, 5:22 p.m. | /u/sjdevelop

Machine Learning www.reddit.com

What is the better approach to develop small scale LLM application,

The usecase is: Feeding some data (possibly containing PII) and use LLM to extract certain information from documents

The problem is if I use third party API such as OpenAI then i would be providing personal information which I do not have any way of masking before hand

The other option is to run llm model on a server, but the model sizes are quite large and would cost …

api application chatgpt data documents extract hosting information llm machinelearning openai open source open source model pii scale small

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne