Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translation. (arXiv:2209.00638v1 [cs.CV])

This paper introduces a unified framework for video action segmentation via
sequence to sequence (seq2seq) translation in a fully and timestamp supervised
setup. In contrast to current state-of-the-art frame-level prediction methods,
we view action segmentation as a seq2seq translation task, i.e., mapping a
sequence of video frames to a sequence of action segments. Our proposed method
involves a series of modifications and auxiliary loss functions on the standard
Transformer seq2seq translation model to cope with long input sequences opposed
to …

arxiv segmentation sequence to sequence temporal translation