Evaluating Large Language Models for Structured Science Summarization in the Open Research Knowledge Graph

arXiv:2405.02105v1 Announce Type: cross
Abstract: Structured science summaries or research contributions using properties or dimensions beyond traditional keywords enhances science findability. Current methods, such as those used by the Open Research Knowledge Graph (ORKG), involve manually curating properties to describe research papers' contributions in a structured manner, but this is labor-intensive and inconsistent between the domain expert human curators. We propose using Large Language Models (LLMs) to automatically suggest these properties. However, it's essential to assess the readiness of LLMs …

abstract arxiv beyond cs.ai cs.cl cs.it current dimensions findability graph keywords knowledge knowledge graph language language models large language large language models math.it papers research research papers science summarization type