VisIRNet: Deep Image Alignment for UAV-taken Visible and Infrared Image Pairs

arXiv:2402.09635v1 Announce Type: new
Abstract: This paper proposes a deep learning based solution for multi-modal image alignment regarding UAV-taken images. Many recently proposed state-of-the-art alignment techniques rely on using Lucas-Kanade (LK) based solutions for a successful alignment. However, we show that we can achieve state of the art results without using LK-based methods. Our approach carefully utilizes a two-branch based convolutional neural network (CNN) based on feature embedding blocks. We propose two variants of our approach, where in the first …

abstract alignment art arxiv cs.cv deep learning image images lucas modal multi-modal paper show solution solutions state state of the art type