Handling Multi-Terabyte LLM Checkpoints // Simon Karasik // MLOps Podcast #228

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/

Huge thank you to @nebiusofficial for sponsoring this episode. Nebius AI - https://nebius.ai/

MLOps podcast #228 with Simon Karasik, Machine Learning Engineer at Nebius AI, Handling Multi-Terabyte LLM Checkpoints.

// Abstract
The talk provides a gentle introduction to the topic of LLM checkpointing: why is it hard, how big are the checkpoints. It covers various tips and tricks for saving and loading multi-terabyte checkpoints, as …

abstract big cloud cloud storage engineer introduction llm loading machine machine learning machine learning engineer mlops mlops podcast podcast saving storage talk tips tricks