[D] Have compression techniques every been applied to the likes of GPT-3 & DALLE-2?

Large language models and the recent spur of diffusion based text-to-image models are gosh-darn fun to play with, but due to their size and expensive training costs - they're only accessible via an API or if you yourself have a access to a large # of GPUs. Yet there are also a number of compression techniques like pruning and quantization that can drastically reduce the size (+90%), and thus computational requirements, of a trained model. Has there been any work …

compression dalle dalle-2 gpt gpt-3 machinelearning