Empowering Multi-step Reasoning across Languages via Tree-of-Thoughts

arXiv:2311.08097v2 Announce Type: replace
Abstract: Reasoning methods, best exemplified by the well-known Chain-of-Thought (CoT), empower the reasoning abilities of Large Language Models (LLMs) by eliciting them to solve complex tasks in a step-by-step manner. Although they are achieving significant success, the ability to deliver multi-step reasoning remains limited to English because of the imbalance in the distribution of pre-training data, which makes other languages a barrier. In this paper, we propose Cross-lingual Tree-of-Thoughts (Cross-ToT), a method for aligning Cross-lingual CoT …

abstract arxiv cs.ai cs.cl english language language models languages large language large language models llms reasoning solve step-by-step success tasks them thought thoughts tree type via