[D] How to train ViT vs CNN

Hi everyone I tried the cat and dog binary classification dataset to practice (224px). First I used a simple CNN with around 2.5 million trainable params, Ir= 1e-3 and 25 epochs. After training the test accuracy was around 90%. After this I tried using the ViT base 16 (around 85 millions trainable parameters) to train with the same exact hyperparameters but after the 25 epochs it only got to 70% test accuracy. What can I do to get better results?

accuracy binary classification cnn dataset dog machinelearning parameters params practice simple test train training vit