#77 - VITALIY CHILEY (Cerebras)

Patreon: https://www.patreon.com/mlst
Discord: https://discord.gg/ESrGqhf5CB

Vitaliy Chiley is a Machine Learning Research Engineer at the next-generation computing hardware company Cerebras Systems. We spoke about how DL workloads including sparse workloads can run faster on Cerebras hardware.

Pod: https://anchor.fm/machinelearningstreettalk/episodes/77---Vitaliy-Chiley-Cerebras-e1k1hvu

[00:00:00] Housekeeping
[00:01:08] Preamble
[00:01:50] Vitaliy Chiley Introduction
[00:03:11] Cerebrus architecture
[00:08:12] Memory management and FLOP utilisation
[00:18:01] Centralised vs decentralised compute architecture
[00:21:12] Sparsity
[00:22:35] Does Sparse NN imply Heterogeneous compute?
[00:28:09] Cost of distributed memory stores?
[00:29:48] Activation vs weight sparsity …

cerebras