Researchers discover in-context learning creates task vectors in LLMs

The researchers show that ICL could be broken down into two distinct steps occurring within the neural network.

context in-context learning llms network neural network researchers show vectors