Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking

arXiv:2403.09629v1 Announce Type: cross
Abstract: When writing and talking, people sometimes pause to think. Although reasoning-focused works have often framed reasoning as a method of answering questions or completing agentic tasks, reasoning is implicit in almost all written text. For example, this applies to the steps not stated between the lines of a proof or to the theory of mind underlying a conversation. In the Self-Taught Reasoner (STaR, Zelikman et al. 2022), useful thinking is learned by inferring rationales from …

abstract arxiv cs.ai cs.cl cs.lg example language language models people questions reasoning speaking star tasks text think type writing