On the Importance of Uncertainty in Decision-Making with Large Language Models

arXiv:2404.02649v1 Announce Type: new
Abstract: We investigate the role of uncertainty in decision-making problems with natural language as input. For such tasks, using Large Language Models as agents has become the norm. However, none of the recent approaches employ any additional phase for estimating the uncertainty the agent has about the world during the decision-making task. We focus on a fundamental decision-making framework with natural language as input, which is the one of contextual bandits, where the context information consists …

abstract agent agents arxiv become cs.lg decision however importance language language models large language large language models making natural natural language norm role tasks type uncertainty