Episode
Scaling Agentic Inference Across Heterogeneous Compute with Zain Asgar - #757
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · Dec 2, 2025 · 49 min
In this episode, Zain Asgar, co-founder and CEO of Gimlet Labs, joins us to discuss the heterogeneous AI inference across diverse hardware. Zain argues that the current industry standard of running all AI workloads on high-end GPUs is unsustainable for agents, which consume significantly more tokens than traditional LLM applications. We explore Gimlet’s approach to heterogeneous inference, which…