Simple NN is doing better than ResNet50 for anomaly detection. What could be the issue?

Using Mel spectrograms for motor sounds, 6000 images each in normal and anomaly category. Used a few augmentation techniques on the training set. I am assuming the data might not be complex enough? Any light you can shed on what's going on here?

anomaly anomaly detection deeplearning detection resnet50