[D] Why FID over a ViT model?

Basically the title sums it up but why do we use a "worse" model to calculate image distance? I would imagine a ViT model is better able to capture semantic differences between images?

differences image images imagine machinelearning semantic vit