uTeBC-NLP at SemEval-2024 Task 9: Can LLMs be Lateral Thinkers?

arXiv:2404.02474v1 Announce Type: cross
Abstract: Inspired by human cognition, Jiang et al.(2023c) create a benchmark for assessing LLMs' lateral thinking-thinking outside the box. Building upon this benchmark, we investigate how different prompting methods enhance LLMs' performance on this task to reveal their inherent power for outside-the-box thinking ability. Through participating in SemEval-2024, task 9, Sentence Puzzle sub-task, we explore prompt engineering methods: chain of thoughts (CoT) and direct prompting, enhancing with informative descriptions, and employing contextualizing prompts using a retrieval …

abstract arxiv benchmark box building cognition cs.ai cs.cl cs.ir cs.lg human llms nlp performance power prompting thinking through type