Response: Emergent analogical reasoning in large language models

arXiv:2308.16118v2 Announce Type: replace
Abstract: In their recent Nature Human Behaviour paper, "Emergent analogical reasoning in large language models," (Webb, Holyoak, and Lu, 2023) the authors argue that "large language models such as GPT-3 have acquired an emergent ability to find zero-shot solutions to a broad range of analogy problems." In this response, we provide counterexamples of the letter string analogies. In our tests, GPT-3 fails to solve simplest variations of the original tasks, whereas human performance remains consistently high …

abstract acquired analogy arxiv authors cs.ai cs.cl gpt gpt-3 human language language models large language large language models nature paper reasoning solutions type zero-shot