The Reversal Curse: LLMs trained on A is B fail to learn B is A

This is a Plain English Papers summary of a research paper called The Reversal Curse: LLMs trained on A is B fail to learn B is A. If you like these kinds of analysis, you should subscribe to the AImodels.fyi newsletter or follow me on Twitter.

Overview

• Surprising failure of auto-regressive large language models (LLMs) to generalize from "A is B" to "B is A"


• This "Reversal Curse" means models trained on sentences like "Valentina Tereshkova was the …

aimodels analysis english learn llms newsletter paper papers plain english papers research research paper summary