Advancing Plain Vision Transformer Towards Remote Sensing Foundation Model. (arXiv:2208.03987v2 [cs.CV] UPDATED)

Large-scale vision foundation models have made significant progress in visual
tasks on natural images, where the vision transformers are the primary choice
for their good scalability and representation ability. However, the utilization
of large models in the remote sensing (RS) community remains under-explored
where existing models are still at small-scale, which limits the performance.
In this paper, we resort to plain vision transformers with about 100 million
parameters and make the first attempt to propose large vision models customized
for …

arxiv cv foundation model remote sensing transformer vision