ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs

arXiv:2309.13007v2 Announce Type: replace-cross
Abstract: Large Language Models (LLMs) still struggle with natural language reasoning tasks. Motivated by the society of minds (Minsky, 1988), we propose ReConcile, a multi-model multiagent framework designed as a round table conference among diverse LLM agents. ReConcile enhances collaborative reasoning between LLM agents via multiple rounds of discussion, learning to convince other agents to improve their answers, and employing a confidence-weighted voting mechanism that leads to a better consensus. In each round, ReConcile initiates discussion …

arxiv conference consensus cs.ai cs.cl cs.lg diverse llms reasoning table type via