Jan. 14, 2024, 1 p.m. | code_your_own_AI

code_your_own_AI www.youtube.com

Is it possible, for any current LLM, to solve this simple task (a 2K prompt)? Any LLM, open-source or proprietary? Intensive testing revealed, that there is an extreme limited amount of LLMs that can solve my simple task, even with a text redundancy of 2 (!) in the prompt! No reasoning involved, just to find info in a text prompt w/ 2k token length. Happy RAG-time!

My test prompt is 1105 words long, contains 8293 characters and (w/ my tokenizer) …

current llm llms prompt reasoning redundancy simple solve testing text

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne