CreativEval: Evaluating Creativity of LLM-Based Hardware Code Generation

arXiv:2404.08806v1 Announce Type: new
Abstract: Large Language Models (LLMs) have proved effective and efficient in generating code, leading to their utilization within the hardware design process. Prior works evaluating LLMs' abilities for register transfer level code generation solely focus on functional correctness. However, the creativity associated with these LLMs, or the ability to generate novel and unique solutions, is a metric not as well understood, in part due to the challenge of quantifying this quality.
To address this research gap, …

abstract arxiv code code generation creativity cs.cl design focus functional hardware however language language models large language large language models llm llms prior process transfer type