OCAI: Improving Optical Flow Estimation by Occlusion and Consistency Aware Interpolation

arXiv:2403.18092v1 Announce Type: new
Abstract: The scarcity of ground-truth labels poses one major challenge in developing optical flow estimation models that are both generalizable and robust. While current methods rely on data augmentation, they have yet to fully exploit the rich information available in labeled video sequences. We propose OCAI, a method that supports robust frame interpolation by generating intermediate video frames alongside optical flows in between. Utilizing a forward warping approach, OCAI employs occlusion awareness to resolve ambiguities in …

abstract arxiv augmentation challenge cs.cv current data exploit flow ground-truth improving information labels major optical optical flow robust truth type video