[R] GPT-4 and ChatGPT sometimes hallucinate to the point where they know they're hallucinating

We just put a paper up where we found a wide array of questions that lead GPT-4 & ChatGPT to hallucinate so badly, to where in a separate chat session they can point out that what they previously said was incorrect.

​

We call these hallucinations snowballed hallucinations.

​

[Turn sound ON to watch our demo](https://reddit.com/link/13oskli/video/fqm405jz7e1b1/player)

The paper is here: [https://ofir.io/snowballed\_hallucination.pdf](https://ofir.io/snowballed_hallucination.pdf)

There's a summary on Twitter here: [https://twitter.com/OfirPress/status/1660646315049533446](https://twitter.com/OfirPress/status/1660646315049533446)

​

I'll be here to answer your questions :)

call chat chatgpt gpt gpt-4 hallucinations machinelearning paper questions session