High-Dimension Human Value Representation in Large Language Models

arXiv:2404.07900v1 Announce Type: new
Abstract: The widespread application of Large Language Models (LLMs) across various tasks and fields has necessitated the alignment of these models with human values and preferences. Given various approaches of human value alignment, ranging from Reinforcement Learning with Human Feedback (RLHF), to constitutional learning, etc. there is an urgent need to understand the scope and nature of human values injected into these models before their release. There is also a need for model alignment without a …

abstract alignment application arxiv cs.ai cs.cl etc feedback fields human human feedback language language models large language large language models llms reinforcement reinforcement learning representation rlhf tasks type value values