UDC: Unified DNAS for Compressible TinyML Models. (arXiv:2201.05842v2 [cs.LG] UPDATED)

Emerging Internet-of-things (IoT) applications are driving deployment of
neural networks (NNs) on heavily constrained low-cost hardware (HW) platforms,
where accuracy is typically limited by memory capacity. To address this TinyML
challenge, new HW platforms like neural processing units (NPUs) have support
for model compression, which exploits aggressive network quantization and
unstructured pruning optimizations. The combination of NPUs with HW compression
and compressible models allows more expressive models in the same memory
footprint.

However, adding optimizations for compressibility on top of …

arxiv tinyml