PAT-Questions: A Self-Updating Benchmark for Present-Anchored Temporal Question-Answering

arXiv:2402.11034v1 Announce Type: new
Abstract: Existing work on Temporal Question Answering (TQA) has predominantly focused on questions anchored to specific timestamps or events (e.g. "Who was the US president in 1970?"). Little work has studied questions whose temporal context is relative to the present time (e.g. "Who was the previous US president?"). We refer to this problem as Present-Anchored Temporal QA (PATQA). PATQA poses unique challenges: (1) large language models (LLMs) may have outdated knowledge, (2) complex temporal relationships (e.g. …

abstract arxiv benchmark context cs.cl events president question question answering questions temporal type us president work