SciFlow: Empowering Lightweight Optical Flow Models with Self-Cleaning Iterations

arXiv:2404.08135v1 Announce Type: new
Abstract: Optical flow estimation is crucial to a variety of vision tasks. Despite substantial recent advancements, achieving real-time on-device optical flow estimation remains a complex challenge. First, an optical flow model must be sufficiently lightweight to meet computation and memory constraints to ensure real-time performance on devices. Second, the necessity for real-time on-device operation imposes constraints that weaken the model's capacity to adequately handle ambiguities in flow estimation, thereby intensifying the difficulty of preserving flow accuracy. …

abstract arxiv challenge cleaning computation constraints cs.cv devices flow memory optical optical flow performance real-time tasks type vision