Neural Plasticity-Inspired Foundation Model for Observing the Earth Crossing Modalities

arXiv:2403.15356v1 Announce Type: new
Abstract: The development of foundation models has revolutionized our ability to interpret the Earth's surface using satellite observational data. Traditional models have been siloed, tailored to specific sensors or data types like optical, radar, and hyperspectral, each with its own unique characteristics. This specialization hinders the potential for a holistic analysis that could benefit from the combined strengths of these diverse data sources. Our novel approach introduces the Dynamic One-For-All (DOFA) model, leveraging the concept of …

abstract arxiv cs.cv data development earth foundation foundation model optical radar satellite sensors surface type types