Episode
How to Engineer AI Inference Systems with Philip Kiely - #766
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · Apr 30, 2026 · 55 min
In this episode, Philip Kiely, head of AI education at Baseten, joins us to unpack the fast-evolving discipline of inference engineering. We explore why inference has become the stickiest and most critical workload in AI, how it blends GPU programming, applied research, and large-scale distributed systems, and where the line sits between inference and model serving. Philip shares how…