April 11, 2024, 4:45 p.m. | /u/avguru1

Artificial Intelligence www.reddit.com

Many services offer "we'll index your PDF, DOCX, etc." files, but we all (should) know that data like this is over-inflated with tons of extraneous data that's not needed and takes longer to parse.

At what point do you think we'll start to see a negligible performance (accuracy) difference between structured and unstructured data?

I understand for some specific models, structured data will always be necessary, but what about for common LLMs?

Edit: Clarification - to be used for fine …

accuracy artificial data difference etc files fine-tuning index isn pdf performance services structured data think training

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Lead Data Modeler

@ Sherwin-Williams | Cleveland, OH, United States