Tensor Quantization: The Untold Story

A close look at the implementation details of quantization in machine learning frameworks

Co-authored with Naresh Singh.

Table Of Contents

• Introduction
• What do the terms scale and zero-point mean for quantization?
• Types of Quantization Schemes
• Quantization Scale and Zero Point examples
• Quantization and Activation Normalization
• Conclusion
• References

Introduction

Throughout the rest of this article, we will try to answer the following questions with concrete examples.

1. What do the terms scale and zero-point mean for quantization?
2. What are the different …

article concrete examples implementation look machine machine learning mean model-quantization normalization quantization questions rest scale singh story table tensor terms types