The end of hallucination (for those who can afford it)? [R]

DeepMind just published a paper about fact-checking text:

​

https://preview.redd.it/zsmv0a0293rc1.png?width=1028&format=png&auto=webp&s=789c1c2f9b31aa734a7ebcf459df3ad06bd74285

The approach costs $0.19 per model response, using GPT-3.5-Turbo, which is cheaper than human annotators, while being more accurate than them:

​

https://preview.redd.it/ob7bb3iv73rc1.png?width=1014&format=png&auto=webp&s=e79bbcaa578b29772cb3b43ead508daff7288091

They use this approach to create a factuality benchmark and compare some popular LLMs.

Paper and code: [https://arxiv.org/abs/2403.18802](https://arxiv.org/abs/2403.18802)

benchmark costs deepmind fact-checking gpt gpt-3 gpt-3.5 gpt-3.5-turbo hallucination human llms machinelearning paper per popular text the end them turbo