Do Visual Transformers have anything equivalent to Pooling in CNN? [Discussion]

I have a regression model based on CNN, works reasonably well with less than 1M parameters. I am trying to check how Visual Transformer (ViT) will perform on this task, but due to lack of pooling in ViT, model size is considerably large (\~10M parameters). Do ViT have anything equivalent to pooling to reduce number of parameters?

If not then that reduces applicability of ViT to large models on large dataset dataset only. For smaller tasks with small dataset, CNN …

check cnn machinelearning pooling regression transformer transformers vit