QuATON: Quantization Aware Training of Optical Neurons

arXiv:2310.03049v2 Announce Type: replace
Abstract: Optical processors, built with "optical neurons", can efficiently perform high-dimensional linear operations at the speed of light. Thus they are a promising avenue to accelerate large-scale linear computations. With the current advances in micro-fabrication, such optical processors can now be 3D fabricated, but with a limited precision. This limitation translates to quantization of learnable parameters in optical neurons, and should be handled during the design of the optical processor in order to avoid a model …

abstract advances arxiv cs.lg current eess.iv fabrication light linear micro neurons operations optical physics.optics precision processors quantization scale speed training type