TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning

arXiv:2404.09275v1 Announce Type: cross
Abstract: Traffic video description and analysis have received much attention recently due to the growing demand for efficient and reliable urban surveillance systems. Most existing methods only focus on locating traffic event segments, which severely lack descriptive details related to the behaviour and context of all the subjects of interest in the events. In this paper, we present TrafficVLM, a novel multi-modal dense video captioning model for vehicle ego camera view. TrafficVLM models traffic video events …

arxiv captioning cs.ai cs.cl cs.cv cs.lg language language model traffic type video visual visual language model