Is it more accurate to use a small object detection model rather than a large one if you only have a few classes?

Web: https://www.reddit.com/r/computervision/comments/vgrnq4/is_it_more_accurate_to_use_a_small_object/

I can’t imagine my 5 custom classes affecting the insane amount of neurons in the SOTA big dogs enough.

Has anyone had experience finding more accuracy in a smaller model despite their benchmark ratings?

I am not new btw you can be technical.

computervision detection model small