Guiding LLMs While Staying in the Driver's Seat // Jacob van Gogh // LLMs in Prod Con Lightning talk

// Abstract
Adept AI is developing a natural language software collaborator that utilizes LLMs to perform software tasks described in natural language. However, LLMs can suffer from overconfidence, hallucinations, and a lack of self-awareness, which can lead to incorrect actions. Jacob highlights an example of how the model can make a wrong action and emphasizes the importance of implementing safety checks such as action reversibility and content filters. By incorporating safety checks, Adept AI aims to improve the model's capabilities …

abstract driver hallucinations language llms natural natural language prod self-awareness software talk van