DeepMind’s Epistemic Neural Networks Enable Large Language Model Fine-Tuning With 50% Less Data

In the new paper Fine-Tuning Language Models via Epistemic Neural Networks, a DeepMind research team modifies large language models to create an Epistemic Neural Network. The novel approach achieves model performance comparable to that obtained via fine-tuning while requiring 50 percent less data.

ai artificial intelligence data deepmind deep-neural-networks fine-tuning language language model large language model machine learning machine learning & data science ml model fine-tuning networks neural networks research technology