MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining

arXiv:2403.13430v1 Announce Type: new
Abstract: Foundation models have reshaped the landscape of Remote Sensing (RS) by enhancing various image interpretation tasks. Pretraining is an active research topic, encompassing supervised and self-supervised learning methods to initialize model weights effectively. However, transferring the pretrained models to downstream tasks may encounter task discrepancy due to their formulation of pretraining as image classification or object discrimination tasks. In this study, we explore the Multi-Task Pretraining (MTP) paradigm for RS foundation models to address this …

abstract arxiv cs.cv foundation foundation model however image interpretation landscape pretrained models pretraining research self-supervised learning sensing supervised learning tasks type via