Boosting Binary Neural Networks via Dynamic Thresholds Learning. (arXiv:2211.02292v1 [eess.IV] CROSS LISTED)

Developing lightweight Deep Convolutional Neural Networks (DCNNs) and Vision
Transformers (ViTs) has become one of the focuses in vision research since the
low computational cost is essential for deploying vision models on edge
devices. Recently, researchers have explored highly computational efficient
Binary Neural Networks (BNNs) by binarizing weights and activations of
Full-precision Neural Networks. However, the binarization process leads to an
enormous accuracy gap between BNN and its full-precision version. One of the
primary reasons is that the Sign function …

arxiv binary boosting networks neural networks