LingoQA: Video Question Answering for Autonomous Driving

arXiv:2312.14115v2 Announce Type: replace-cross
Abstract: Autonomous driving has long faced a challenge with public acceptance due to the lack of explainability in the decision-making process. Video question-answering (QA) in natural language provides the opportunity for bridging this gap. Nonetheless, evaluating the performance of Video QA models has proved particularly tough due to the absence of comprehensive benchmarks. To fill this gap, we introduce LingoQA, a benchmark specifically for autonomous driving Video QA. The LingoQA trainable metric demonstrates a 0.95 Spearman …

abstract arxiv autonomous autonomous driving challenge cs.ai cs.cv cs.ro decision driving explainability gap language making natural natural language performance process public question question answering type video