The Era of Semantic Decoding

arXiv:2403.14562v1 Announce Type: new
Abstract: Recent work demonstrated great promise in the idea of orchestrating collaborations between LLMs, human input, and various tools to address the inherent limitations of LLMs. We propose a novel perspective called semantic decoding, which frames these collaborative processes as optimization procedures in semantic space. Specifically, we conceptualize LLMs as semantic processors that manipulate meaningful pieces of information that we call semantic tokens (known thoughts). LLMs are among a large pool of other semantic processors, including …

abstract arxiv collaborations collaborative cs.ai cs.cl cs.hc cs.ma decoding human limitations llms novel optimization perspective processes semantic space tools type work