ProMotion: Prototypes As Motion Learners

arXiv:2406.04999v1 Announce Type: new
Abstract: In this work, we introduce ProMotion, a unified prototypical framework engineered to model fundamental motion tasks. ProMotion offers a range of compelling attributes that set it apart from current task-specific paradigms. We adopt a prototypical perspective, establishing a unified paradigm that harmonizes disparate motion learning approaches. This novel paradigm streamlines the architectural design, enabling the simultaneous assimilation of diverse motion information. We capitalize on a dual mechanism involving the feature denoiser and the prototypical learner …

abstract arxiv attributes cs.cv current framework fundamental novel paradigm perspective promotion set tasks type work