Are we all prompting wrong? Balancing Creativity and Consistency in RAG.

For a Boston native like myself, there are few things more heartwarming than Artificial Intelligence understanding the brilliance of Good Will Hunting. A few cursory prompts reveal that it views it as a "must-watch tale of redemption and self discovery".

But a slightly closer look reveals what many users of LLMs have accepted as a given - slight variations on an otherwise consistent topic. This is the result of Stochastic Generation.

Stochastic generation 🤖

This is a fairly common …

ai artificial artificial intelligence boston closer look creativity discovery good hunting intelligence llm look prompting prompts python rag redemption things understanding will