Prompting LLMs to Compose Meta-Review Drafts from Peer-Review Narratives of Scholarly Manuscripts

arXiv:2402.15589v1 Announce Type: cross
Abstract: One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves understanding the core contributions, strengths, and weaknesses of a scholarly manuscript based on peer-review narratives from multiple experts and then summarizing those multiple experts' perspectives into a concise holistic overview. Given the latest major developments in generative AI, especially Large Language Models (LLMs), it is very compelling to rigorously study the utility of LLMs in generating such …

abstract academic arxiv core cs.ai cs.cl cs.lg cs.ne experts llms meta multiple peer peer-review perspectives process prompting prompting llms review reviews summarizing tasks type understanding