[Research] "Language models can explain neurons in language models" from OpenAI

This new piece of research was released today (2023-05-09) by OpenAI: https://openai.com/research/language-models-can-explain-neurons-in-language-models

Using the `neuron-explainer` tool, you can drill down into individual neurons, e.g., here's one for "transition words at the beginning of sentences" like `however`, `additionally`, `since`, etc. https://openaipublic.blob.core.windows.net/neuron-explainer/neuron-viewer/index.html#/layers/15/neurons/4538

There's also an option to submit a better explanation for what the neuron is doing. (OpenAI is crowdsourcing the reinforcement learning human feedback - RLHF - portion of model building, it seems.) Perhaps you think you have a better label …

building click crowdsourcing feedback human human feedback languagetechnology neuron openai reinforcement reinforcement learning rlhf think transition words