Art or Artifice? Large Language Models and the False Promise of Creativity

arXiv:2309.14556v2 Announce Type: replace
Abstract: Researchers have argued that large language models (LLMs) exhibit high-quality writing capabilities from blogs to stories. However, evaluating objectively the creativity of a piece of writing is challenging. Inspired by the Torrance Test of Creative Thinking (TTCT), which measures creativity as a process, we use the Consensual Assessment Technique [3] and propose the Torrance Test of Creative Writing (TTCW) to evaluate creativity as a product. TTCW consists of 14 binary tests organized into the original …

abstract art arxiv blogs capabilities creative creative thinking creativity cs.ai cs.cl cs.hc false language language models large language large language models llms process quality researchers stories test thinking type writing