What are human values, and how do we align AI to them?

arXiv:2404.10636v1 Announce Type: cross
Abstract: There is an emerging consensus that we need to align AI systems with human values (Gabriel, 2020; Ji et al., 2024), but there is very little work on what that means and how we actually do it. We split the problem of "aligning to human values" into three parts: first, eliciting values from people; second, reconciling those values into an alignment target for training ML models; and third, actually training the model. In this paper, …

abstract ai systems arxiv consensus cs.ai cs.cl cs.cy cs.hc cs.lg gabriel human split systems them type values work