Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMs

arXiv:2405.03690v1 Announce Type: new
Abstract: Recent advancements in Large Language Models (LLMs) have led to the development of Video Large Multi-modal Models (Video-LMMs) that can handle a wide range of video understanding tasks. These models have the potential to be deployed in real-world applications such as robotics, AI assistants, medical imaging, and autonomous vehicles. The widespread adoption of Video-LMMs in our daily lives underscores the importance of ensuring and evaluating their robust performance in mirroring human-like reasoning and interaction capabilities …

arxiv cs.cv evaluation lmms reasoning robustness type video