Faster Inference of Integer SWIN Transformer by Removing the GELU Activation

SWIN transformer is a prominent vision transformer model that has state-of-the-art accuracy in image classification tasks. Despite this success, its unique architecture causes slower inference compared with similar deep neural networks. Integer quantization of the model is one of the methods used to improve its inference latency. However, state-of-the-art has not been able to fully quantize the model. In this work, we improve upon the inference latency of the state-of-the-art methods by removing the floating-point operations, which are associated with …

accuracy architecture art classification cs.ai cs.cv faster image inference latency networks neural networks quantization state success swin swin transformer tasks transformer transformer model vision vision transformer model