Episode
The Uncertain Art of Accelerating ML Models with Sylvain Gugger
Signals and Threads · Oct 14, 2024 · 1 h 06 min
Sylvain Gugger is a former math teacher who fell into machine learning via a MOOC and became an expert in the low-level performance details of neural networks. He’s now on the ML infrastructure team at Jane Street, where he helps traders speed up their models. In this episode, Sylvain and Ron go deep on learning rate schedules; the subtle performance bugs PyTorch lets you write; how to keep a…