[D] What's the biggest challenge you face when deploying ML models on your own cloud (Azure/AWS/GCP)?

Hi, This is a market research post to understand the challenges people face while deploying open-source or custom ML models in production on their own cloud (AWS/Azure/GCP).

Options:

1. Deployment complexity (K8S, Knative, Ray, etc)
2. Autoscaling wrt user demand
3. Lack of GPU availability (spot instances, quota limit)
4. Setting up CI/CD

aws azure challenge challenges cloud complexity demand deployment etc face gcp gpu k8s machinelearning market market research ml models people production ray research while