Transformers for tasks on videos

Hello everyone!

For a project of mine involving video data (temporal RGB data), I was contemplating the usage of transformers/attention for the task head to perform a specific task, say action recognition in a video. The high-level idea was to use different (task-relevant) features and then use an attention mechanism to do the final task. I had a few questions for the same -

1. How feasible it would be to train such a network (transformer/attention part?)
2. If this …

computervision transformers videos