[R] Into the Unknown: Self-Learning Large Language Models

**Paper**: [https://arxiv.org/abs/2402.09147](https://arxiv.org/abs/2402.09147)

**Code**: [https://github.com/teddy-f-47/self-learning-llm-public](https://github.com/teddy-f-47/self-learning-llm-public)

**Abstract**:

>We address the main problem of self-learning LLM: the question of what to learn. We propose a self-learning LLM framework that enables an LLM to independently learn previously unknown knowledge through self-assessment of their own hallucinations. Using the hallucination score, we introduce a new concept of **Points in The Unknown** (**PiUs**), along with one extrinsic and three intrinsic methods for automatic PiUs identification. It facilitates the creation of a self-learning loop that focuses exclusively on …

abstract assessment concept framework hallucination hallucinations intrinsic knowledge learn llm machinelearning question self-learning the unknown through