Tools and Technologies for Machine Learning in Kubernetes Environment

Pascal shares the list of tools and technologies used in the last few projects, where Kubernetes was the primary technology used for machine learning. For nonfunctional tooling, they used Prometheus, Grafana, and LOKI. They utilized Kubernetes to make sure that GPUs were available for the pods and ran Ray cluster on top of Kubernetes to deploy models across different nodes. Finally, they used ALPA to run very large models. This podcast clip provides insights into the various tools and technologies …

cluster environment gpus kubernetes list machine machine learning pascal projects prometheus ray shares technologies technology tooling tools