P3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervision. (arXiv:2205.02300v1 [cs.CV])

Web: http://arxiv.org/abs/2205.02300

In this paper, we study the problem of procedure planning in instructional
videos. Here, an agent must produce a plausible sequence of actions that can
transform the environment from a given start to a desired goal state. When
learning procedure planning from instructional videos, most recent work
leverages intermediate visual observations as supervision, which requires
expensive annotation efforts to localize precisely all the instructional steps
in training videos. In contrast, we remove the need for expensive temporal
video annotations and …

arxiv cv planning videos