Is Tensorflow-Metal Optimized for M3 Pro Chip? [D]

I have tried downloading the Tensorflow-Metal package for my multi-attention head transformer for disease risk prediction on sequence data. However when I use the GPU and I did validate it is being utilized, is it taking 3 times as long than the CPU. The batch sizes are set to 32 for the validation and testing. Any tips or ideas would be greatly appreciated :)

attention chip cpu data disease gpu head m3 pro machinelearning metal package prediction risk set tensorflow transformer