QCore: Data-Efficient, On-Device Continual Calibration for Quantized Models -- Extended Version

arXiv:2404.13990v1 Announce Type: new
Abstract: We are witnessing an increasing availability of streaming data that may contain valuable information on the underlying processes. It is thus attractive to be able to deploy machine learning models on edge devices near sensors such that decisions can be made instantaneously, rather than first having to transmit incoming data to servers. To enable deployment on edge devices with limited storage and computational capabilities, the full-precision parameters in standard models can be quantized to use …

abstract arxiv availability continual cs.db cs.lg data decisions deploy devices edge edge devices information machine machine learning machine learning models near processes sensors streaming streaming data type