Jan. 16, 2024, 12:50 p.m. | /u/East_Dragonfruit7277

Machine Learning www.reddit.com

Hi everyone,

We've shared some practical insights on Retrieval Augmented Generation (RAG) with our custom data processing framework called Fondant in our latest blogpost.

Finetuning RAG is a complex task that requires a lot of time and effort. We built an example pipeline that indexes a custom knowledge base (PDF, Huggingface dataset, ...), processes the data (embedding, chunking,...) and evaluates the results. We integrated different parameters search techniques for picking the best configuration which results in the best outcome for …

automated data data processing dataset example finetuning framework huggingface insights knowledge knowledge base machinelearning optimization pdf pipeline practical processing rag retrieval retrieval augmented generation

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US