Learning Object State Changes in Videos: An Open-World Perspective

arXiv:2312.11782v2 Announce Type: replace
Abstract: Object State Changes (OSCs) are pivotal for video understanding. While humans can effortlessly generalize OSC understanding from familiar to unknown objects, current approaches are confined to a closed vocabulary. Addressing this gap, we introduce a novel open-world formulation for the video OSC problem. The goal is to temporally localize the three stages of an OSC -- the object's initial state, its transitioning state, and its end state -- whether or not the object has been …

abstract arxiv cs.cv current gap humans novel object objects open-world osc perspective pivotal state type understanding video videos video understanding world