Reasoning over the Behaviour of Objects in Video-Clips for Adverb-Type Recognition

arXiv:2307.04132v3 Announce Type: replace
Abstract: In this work, following the intuition that adverbs describing scene-sequences are best identified by reasoning over high-level concepts of object-behavior, we propose the design of a new framework that reasons over object-behaviours extracted from raw-video-clips to recognize the clip's corresponding adverb-types. Importantly, while previous works for general scene adverb-recognition assume knowledge of the clips underlying action-types, our method is directly applicable in the more general problem setting where the action-type of a video-clip is unknown. …

abstract arxiv behavior clip concepts cs.ai cs.cv cs.sc design framework intuition object objects raw reasoning recognition type types video work