ZeroGen: Efficient Zero-shot Learning via Dataset Generation. (arXiv:2202.07922v2 [cs.CL] UPDATED)

There is a growing interest in dataset generation recently due to the
superior generative capacity of large pre-trained language models (PLMs). In
this paper, we study a flexible and efficient zero-short learning method,
\textsc{ZeroGen}. Given a zero-shot task, we first generate a dataset from
scratch using PLMs in an unsupervised manner. Then, we train a tiny task model
(e.g., LSTM) under the supervision of the synthesized dataset. This approach
allows highly efficient inference as the final task model only has …

arxiv dataset dataset generation