[D] Will we ever see analog deep learning take over digital?

The biggest advances in deep learning have been mostly due to scale. Ie. DALL·E 2, GPT-3...

Take this to an extreme, and the limiting factor becomes power and cost of the silicon required for the computation. Cost is a purely human factor, and could be almost eliminated through mass production (rather like solar costs reduced 100x in 50 years, mostly due to mass production and automation).

Power can also be reduced, but big advances in power use for dense math …

analog deep learning digital learning machinelearning