Spatio-Temporal SwinMAE: A Swin Transformer based Multiscale Representation Learner for Temporal Satellite Imagery

arXiv:2405.02512v1 Announce Type: new
Abstract: Currently, the foundation models represented by large language models have made dramatic progress and are used in a very wide range of domains including 2D and 3D vision. As one of the important application domains of foundation models, earth observation has attracted attention and various approaches have been developed. When considering earth observation as a single image capture, earth observation imagery can be processed as an image with three or more channels, and when it …

abstract application arxiv cs.ai cs.cv domains earth earth observation foundation language language models large language large language models observation progress representation satellite swin swin transformer temporal transformer type vision