MemFlow: Optical Flow Estimation and Prediction with Memory

arXiv:2404.04808v1 Announce Type: new
Abstract: Optical flow is a classical task that is important to the vision community. Classical optical flow estimation uses two frames as input, whilst some recent methods consider multiple frames to explicitly model long-range information. The former ones limit their ability to fully leverage temporal coherence along the video sequence; and the latter ones incur heavy computational overhead, typically not possible for real-time flow estimation. Some multi-frame-based approaches even necessitate unseen future frames for current estimation, …

arxiv cs.cv flow memory optical optical flow prediction type