Self-Distilled Vision Transformer for Domain Generalization. (arXiv:2207.12392v2 [cs.CV] UPDATED)

In recent past, several domain generalization (DG) methods have been
proposed, showing encouraging performance, however, almost all of them build on
convolutional neural networks (CNNs). There is little to no progress on
studying the DG performance of vision transformers (ViTs), which are
challenging the supremacy of CNNs on standard benchmarks, often built on i.i.d
assumption. This renders the real-world deployment of ViTs doubtful. In this
paper, we attempt to explore ViTs towards addressing the DG problem. Similar to
CNNs, ViTs …

arxiv cv transformer vision