Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Models

arXiv:2305.16582v2 Announce Type: replace
Abstract: With the widespread use of language models (LMs) in NLP tasks, researchers have discovered the potential of Chain-of-thought (CoT) to assist LMs in accomplishing complex reasoning tasks by generating intermediate steps. However, human thought processes are often non-linear, rather than simply sequential chains of thoughts. Therefore, we propose Graph-of-Thought (GoT) reasoning, which models human thought processes not only as a chain but also as a graph. By representing thought units as nodes and connections between …

abstract arxiv beyond cs.cl graph however human intermediate language language models linear lms nlp non-linear processes reasoning researchers tasks thought thoughts type