[R] Locating and Editing Factual Knowledge in GPT

https://i.redd.it/rktep95sdpz81.gif

Here's an interesting paper from MIT CSAIL on a method to edit knowledge within language models — sets up a nice framework for knowledge editing and representation, and a reference dataset to test facts within a model.

Model editing colab: [https://colab.research.google.com/github/kmeng01/rome/blob/main/notebooks/rome.ipynb](https://colab.research.google.com/github/kmeng01/rome/blob/main/notebooks/rome.ipynb)

Causal tracing colab: [https://colab.research.google.com/github/kmeng01/rome/blob/main/notebooks/causal\_trace.ipynb](https://colab.research.google.com/github/kmeng01/rome/blob/main/notebooks/causal_trace.ipynb)

Github: [https://github.com/kmeng01/rome](https://github.com/kmeng01/rome)

Abstract: We investigate the mechanisms underlying factual knowledge recall in autoregressive transformer language models. First, we develop a causal intervention for identifying neuron activations capable of altering a model’s factual predictions. Within …

gpt knowledge machinelearning