XoFTR: Cross-modal Feature Matching Transformer

arXiv:2404.09692v1 Announce Type: new
Abstract: We introduce, XoFTR, a cross-modal cross-view method for local feature matching between thermal infrared (TIR) and visible images. Unlike visible images, TIR images are less susceptible to adverse lighting and weather conditions but present difficulties in matching due to significant texture and intensity differences. Current hand-crafted and learning-based methods for visible-TIR matching fall short in handling viewpoint, scale, and texture diversities. To address this, XoFTR incorporates masked image modeling pre-training and fine-tuning with pseudo-thermal image …

abstract arxiv cs.cv current differences feature images intensity lighting modal texture transformer type view weather