LLMs Everywhere: Running 70B models in browsers and iPhones using MLC — with Tianqi Chen of CMU / OctoML

Listen now (52 mins) | Compilers are all you need. How XGBoost and TVM were created, and the future of universal model deployments with MLC!

browsers chen cmu compilers future llms mlc octoml running xgboost