Advancing Plain Vision Transformer Towards Remote Sensing Foundation Model. (arXiv:2208.03987v3 [cs.CV] UPDATED)

Large-scale vision foundation models have made significant progress in visual
tasks on natural images, with vision transformers being the primary choice due
to their good scalability and representation ability. However, large-scale
models in remote sensing (RS) have not yet been sufficiently explored. In this
paper, we resort to plain vision transformers with about 100 million parameters
and make the first attempt to propose large vision models tailored to RS tasks
and investigate how such large models perform. To handle the …

arxiv foundation model remote sensing transformer vision