When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviour

arXiv:2311.09410v2 Announce Type: replace
Abstract: Large Language Models have been demonstrating the ability to solve complex tasks by delivering answers that are positively evaluated by humans due in part to the intensive use of human feedback that refines responses. However, the suggestibility transmitted through human feedback increases the inclination to produce responses that correspond to the users' beliefs or misleading prompts as opposed to true facts, a behaviour known as sycophancy. This phenomenon decreases the bias, robustness, and, consequently, their …

abstract arxiv cs.ai cs.cl feedback however human human feedback humans language language models large language large language models part responses solve tasks through type