March 29, 2024, 4:47 a.m. | Chinmaya Andukuri, Jan-Philipp Fr\"anken, Tobias Gerstenberg, Noah D. Goodman

cs.CL updates on arXiv.org arxiv.org

arXiv:2403.19154v1 Announce Type: new
Abstract: When prompting language models to complete a task, users often leave important aspects unsaid. While asking questions could resolve this ambiguity \citep[GATE;][]{li2023eliciting}, models often struggle to ask good questions. We explore a language model's ability to self-improve \citep[STaR;][]{zelikman2022star} by rewarding the model for generating useful questions -- a simple method we dub STaR-GATE. We generate a synthetic dataset of 25,500 unique persona-task prompts to simulate conversations between a pretrained language model -- the \texttt{Questioner} -- …

abstract arxiv cs.ai cs.cl explore gate good language language model language models prompting questions star struggle teaching type

Data Scientist (m/f/x/d)

@ Symanto Research GmbH & Co. KG | Spain, Germany

Senior DevOps/MLOps

@ Global Relay | Vancouver, British Columbia, Canada

Senior Statistical Programmer for Clinical Development

@ Novo Nordisk | Aalborg, North Denmark Region, DK

Associate, Data Analysis

@ JLL | USA-CLIENT Boulder CO-Google

AI Compiler Engineer, Model Optimization, Quantization & Framework

@ Renesas Electronics | Duesseldorf, Germany

Lead AI Security Researcher

@ Grammarly | United States; Hybrid