April 11, 2024, 4:45 p.m. | /u/avguru1

Artificial Intelligence www.reddit.com

Many services offer "we'll index your PDF, DOCX, etc." files, but we all (should) know that data like this is over-inflated with tons of extraneous data that's not needed and takes longer to parse.

At what point do you think we'll start to see a negligible performance (accuracy) difference between structured and unstructured data?

I understand for some specific models, structured data will always be necessary, but what about for common LLMs?

Edit: Clarification - to be used for fine …

accuracy artificial data difference etc files fine-tuning index isn pdf performance services structured data think training

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US

Research Engineer

@ Allora Labs | Remote

Ecosystem Manager

@ Allora Labs | Remote

Founding AI Engineer, Agents

@ Occam AI | New York