CMT: Cross Modulation Transformer with Hybrid Loss for Pansharpening

arXiv:2404.01121v1 Announce Type: new
Abstract: Pansharpening aims to enhance remote sensing image (RSI) quality by merging high-resolution panchromatic (PAN) with multispectral (MS) images. However, prior techniques struggled to optimally fuse PAN and MS images for enhanced spatial and spectral information, due to a lack of a systematic framework capable of effectively coordinating their individual strengths. In response, we present the Cross Modulation Transformer (CMT), a pioneering method that modifies the attention mechanism. This approach utilizes a robust modulation technique from …

abstract arxiv cs.cv eess.iv framework however hybrid image images information loss merging prior quality resolution sensing spatial transformer type