Industry folks, specifically who use on-device with limited HW, are you using transformers or is still CNN's?

Just wondering how other groups are doing it, since we're still deep in CNN's due to severe HW limitations, sub 1-mill params models specifically.

cnn computervision industry limitations params transformers