Contrastive Pretraining for Visual Concept Explanations of Socioeconomic Outcomes

arXiv:2404.09768v1 Announce Type: new
Abstract: Predicting socioeconomic indicators from satellite imagery with deep learning has become an increasingly popular research direction. Post-hoc concept-based explanations can be an important step towards broader adoption of these models in policy-making as they enable the interpretation of socioeconomic outcomes based on visual concepts that are intuitive to humans. In this paper, we study the interplay between representation learning using an additional task-specific contrastive loss and post-hoc concept explainability for socioeconomic studies. Our results on …

abstract adoption arxiv become concept concepts cs.cv deep learning interpretation making policy popular pretraining research satellite type visual visual concepts