Generative AI-Based Text Generation Methods Using Pre-Trained GPT-2 Model

arXiv:2404.01786v1 Announce Type: new
Abstract: This work delved into the realm of automatic text generation, exploring a variety of techniques ranging from traditional deterministic approaches to more modern stochastic methods. Through analysis of greedy search, beam search, top-k sampling, top-p sampling, contrastive searching, and locally typical searching, this work has provided valuable insights into the strengths, weaknesses, and potential applications of each method. Each text-generating method is evaluated using several standard metrics and a comparative study has been made on …

abstract analysis arxiv cs.cl generative gpt gpt-2 modern realm sampling search searching stochastic text text generation through type work